-- Logs begin at Wed 2022-08-24 02:44:53 UTC, end at Wed 2022-08-24 03:55:14 UTC. -- Aug 24 03:21:52.974069 dv-cinder-854261-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 03:21:52.982899 dv-cinder-854261-1-iscsi devstack@n-api.service[105516]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 03:21:52.984913 dv-cinder-854261-1-iscsi devstack@n-api.service[105516]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 03:21:52 2022] *** Aug 24 03:21:52.984913 dv-cinder-854261-1-iscsi devstack@n-api.service[105516]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 03:21:52.984913 dv-cinder-854261-1-iscsi devstack@n-api.service[105516]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 03:21:52.984913 dv-cinder-854261-1-iscsi devstack@n-api.service[105516]: nodename: dv-cinder-854261-1-iscsi Aug 24 03:21:52.984913 dv-cinder-854261-1-iscsi devstack@n-api.service[105516]: machine: x86_64 Aug 24 03:21:52.984913 dv-cinder-854261-1-iscsi devstack@n-api.service[105516]: clock source: unix Aug 24 03:21:52.984913 dv-cinder-854261-1-iscsi devstack@n-api.service[105516]: pcre jit disabled Aug 24 03:21:52.984913 dv-cinder-854261-1-iscsi devstack@n-api.service[105516]: detected number of CPU cores: 4 Aug 24 03:21:52.984913 dv-cinder-854261-1-iscsi devstack@n-api.service[105516]: current working directory: / Aug 24 03:21:52.984913 dv-cinder-854261-1-iscsi devstack@n-api.service[105516]: detected binary path: /usr/bin/uwsgi-core Aug 24 03:21:52.984913 dv-cinder-854261-1-iscsi devstack@n-api.service[105516]: your processes number limit is 47680 Aug 24 03:21:52.984913 dv-cinder-854261-1-iscsi devstack@n-api.service[105516]: your memory page size is 4096 bytes Aug 24 03:21:52.984913 dv-cinder-854261-1-iscsi devstack@n-api.service[105516]: detected max file descriptor number: 2048 Aug 24 03:21:52.984913 dv-cinder-854261-1-iscsi devstack@n-api.service[105516]: lock engine: pthread robust mutexes Aug 24 03:21:52.984913 dv-cinder-854261-1-iscsi devstack@n-api.service[105516]: thunder lock: enabled Aug 24 03:21:52.985755 dv-cinder-854261-1-iscsi devstack@n-api.service[105516]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 03:21:52.985755 dv-cinder-854261-1-iscsi devstack@n-api.service[105516]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 03:21:53.023619 dv-cinder-854261-1-iscsi devstack@n-api.service[105516]: Python main interpreter initialized at 0x56454ea0b9c0 Aug 24 03:21:53.023619 dv-cinder-854261-1-iscsi devstack@n-api.service[105516]: python threads support enabled Aug 24 03:21:53.023619 dv-cinder-854261-1-iscsi devstack@n-api.service[105516]: your server socket listen backlog is limited to 100 connections Aug 24 03:21:53.023619 dv-cinder-854261-1-iscsi devstack@n-api.service[105516]: your mercy for graceful operations on workers is 90 seconds Aug 24 03:21:53.023970 dv-cinder-854261-1-iscsi devstack@n-api.service[105516]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 03:21:53.024063 dv-cinder-854261-1-iscsi devstack@n-api.service[105516]: *** Operational MODE: preforking *** Aug 24 03:21:53.024276 dv-cinder-854261-1-iscsi devstack@n-api.service[105516]: *** uWSGI is running in multiple interpreter mode *** Aug 24 03:21:53.024276 dv-cinder-854261-1-iscsi devstack@n-api.service[105516]: spawned uWSGI master process (pid: 105516) Aug 24 03:21:53.024469 dv-cinder-854261-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 03:21:53.025065 dv-cinder-854261-1-iscsi devstack@n-api.service[105516]: spawned uWSGI worker 1 (pid: 105517, cores: 1) Aug 24 03:21:53.025411 dv-cinder-854261-1-iscsi devstack@n-api.service[105516]: spawned uWSGI worker 2 (pid: 105518, cores: 1) Aug 24 03:21:53.025868 dv-cinder-854261-1-iscsi devstack@n-api.service[105516]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 03:21:53.687735 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 03:21:53.688356 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 03:21:54.778784 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:21:54.778784 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: from cryptography.utils import int_from_bytes Aug 24 03:21:54.779807 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:21:54.779807 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: from cryptography.utils import int_from_bytes Aug 24 03:21:54.779974 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:21:54.779974 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: from cryptography.utils import int_from_bytes Aug 24 03:21:54.779974 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:21:54.779974 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: from cryptography.utils import int_from_bytes Aug 24 03:21:57.298907 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 03:21:57.299427 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 03:21:57.299599 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 03:21:57.300003 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 03:21:57.300353 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 03:21:57.300757 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.300881 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 03:21:57.301228 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 03:21:57.301307 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.301400 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.301591 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 03:21:57.301722 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.301957 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 03:21:57.302052 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.302217 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 03:21:57.302352 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.302609 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.302694 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.302937 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.303020 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.303260 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.303351 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.303541 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.303633 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.303855 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.304030 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.304180 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854261-1-iscsi {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.304271 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.304505 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.304595 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.304836 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.304935 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.305151 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.305243 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.305455 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.305537 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.305771 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.305862 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.306092 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.306178 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854261-1-iscsi {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.306400 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.306483 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.306710 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.306894 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.307025 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.307342 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.307469 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.307639 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.307731 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.307955 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.308048 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.308259 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.308349 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.308595 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.308751 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.308959 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.309127 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.309280 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.309422 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.309591 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.309702 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.309916 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.310043 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.310226 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.310328 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.310629 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854261-1-iscsi {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.310724 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.310939 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.311061 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.311249 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.311338 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.311560 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.311655 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.311872 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.311973 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.312267 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854261-1-iscsi {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.312358 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.312574 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.312676 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.312908 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.313010 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.313225 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.313324 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.313538 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.313639 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.313875 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.313966 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.314196 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.314303 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.314518 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.314617 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.314839 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.314929 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.315142 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.315233 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.315443 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.316064 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.316587 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.316674 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.316754 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.316992 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.317070 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.317148 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.317215 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.317279 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.317444 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.317621 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.317750 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.317841 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.318073 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.318171 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.318398 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.318495 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.318724 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.318813 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.318976 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.319092 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.319230 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.319321 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.319548 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.319643 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.319874 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.319963 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.320182 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.320269 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.320449 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.320544 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.320705 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.320823 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.321055 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.321153 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.321377 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.321481 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.321685 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.321787 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.321993 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.322090 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.322298 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.322417 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.322641 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.322746 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.322906 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.323012 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.323212 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.323308 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.323520 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.323608 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.323826 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.323915 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.324147 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.324241 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.81 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.324463 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.81 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.324566 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.324801 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.324906 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.325107 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.325203 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.325430 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.325521 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.325739 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.325828 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.81 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.326059 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.326149 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.81 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.326382 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.326478 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.326699 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.326797 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.327009 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.327099 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.327323 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.327412 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.327642 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.327792 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.327976 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.328126 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.328285 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.328426 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.328561 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.328707 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.328884 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.329030 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.329165 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.329300 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.329434 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.329649 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.329803 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.329962 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.330150 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.330286 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.330421 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.330635 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.330780 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.330917 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.331051 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.331218 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.332291 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.332445 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.332596 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.332794 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.332938 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.333087 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.333223 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.333371 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.333516 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.333652 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.333786 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.333928 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.334107 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.334256 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.334392 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.334538 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.334682 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.334818 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.334961 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.335105 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.335248 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.335391 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.335539 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.335674 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.335818 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.335955 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.336133 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.336273 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.336419 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.336562 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.336708 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.336892 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.337041 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.337187 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.337322 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.337468 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.337621 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.337766 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.337909 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.338044 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.338190 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.338325 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.338467 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.338610 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.338752 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.338888 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.339028 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.339163 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.339312 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.339456 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.339591 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.339725 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.339860 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.340004 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.340147 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.340285 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.340427 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.340570 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.340720 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.340891 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.341036 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.341172 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.341305 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.341439 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.341572 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.341716 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.341861 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.342003 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.342146 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.342282 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.342424 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.342568 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.342703 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.342837 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.342971 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.343106 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.343240 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.343382 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.343518 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.343661 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.343796 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.343930 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.344077 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.344220 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.344355 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.344552 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.344695 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.344887 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.345043 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.345181 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.345317 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.345493 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.345636 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.345813 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:21:57.345965 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.346152 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.346303 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.346489 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.346632 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.346862 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.347504 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.347651 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.347788 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.347924 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.348072 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.348217 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.348217 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.348475 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.348610 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.348745 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.348912 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.349066 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.349203 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.349338 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.349473 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.349608 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.349779 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.349930 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.350093 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.350243 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.350387 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.350524 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.350659 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.350808 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.350945 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.351088 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.351227 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.351362 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.351538 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.351767 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.351916 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.352054 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.352189 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.352325 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.352460 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.352631 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.352850 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.352996 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.353132 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.353279 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.353425 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.353599 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.353753 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.353917 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.354068 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.354233 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.354384 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.354548 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.354690 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.354875 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.355021 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.355208 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.355360 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.355524 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.355676 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.355845 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.355996 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.356163 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.356315 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.356479 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.356630 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.356801 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.356944 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.357122 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.357523 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.357688 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.357830 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.358028 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.358172 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.358345 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.358487 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.358662 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.358804 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.358973 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.359113 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.359292 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.359435 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.359605 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.359823 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.359966 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.360120 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.360267 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.360410 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.360545 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.360680 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.360874 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.361034 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.361179 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.361355 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.361499 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.361636 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.361782 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.361926 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.362072 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.362208 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.362366 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.362589 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.363112 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.363271 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.363271 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.363566 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.363710 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.363852 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.364003 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.364156 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.364299 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.364453 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.364596 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.364737 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.364920 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.365066 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.365209 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.365349 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.365491 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.365632 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.365783 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.365926 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.366067 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.366219 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.366362 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.366504 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.366654 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.366841 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.366985 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.367135 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.367278 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.367419 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.367570 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.367719 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.367862 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.368003 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.368155 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.368306 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.368450 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.368592 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.368740 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.368922 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.369076 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.369229 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.369379 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.369523 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.369666 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.369814 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.369965 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.370128 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.370282 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.370431 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.370574 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.370724 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.370867 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.371017 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.371160 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.371318 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.371463 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.371604 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.371754 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.371907 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.372056 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.372206 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.372356 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.372499 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.372649 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.372814 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.372964 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.373106 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.373260 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.373412 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.373564 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.373707 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.373871 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.374014 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.374156 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.374297 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.374446 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.374628 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.374785 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.374930 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.375071 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.375220 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.375363 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.375505 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.375646 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.375796 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.375938 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.376092 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.376243 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.376387 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.376530 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.376675 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.376855 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.377015 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.377161 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.377302 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.377444 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.377585 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.377744 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.377898 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.378614 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.379225 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.379225 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.379519 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.379519 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.379801 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.379952 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.380096 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.380239 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.380389 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.380389 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.380682 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.380682 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.380997 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.381139 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.381282 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.381504 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.381657 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.381801 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.381975 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.382121 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.382264 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.382414 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.382577 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.382763 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.382910 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.383053 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.383194 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.383346 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.383496 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.383639 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.383781 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.383935 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.384092 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.384235 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.384378 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.384530 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.384671 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.384835 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.384996 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.385140 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.385281 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.385430 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.385573 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.385573 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.385864 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.386014 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.386220 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.386375 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.386530 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.386672 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.386823 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.386966 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.387107 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.387257 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.387399 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.387611 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.387759 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.387911 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.388062 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.388204 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.388353 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.388515 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.388660 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.388855 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.389004 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.389146 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.389298 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.389450 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.389595 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.389736 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.389890 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.390040 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.390183 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.390333 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.390486 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.390637 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.390781 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.390922 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.391071 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.391222 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.391371 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.391512 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.391665 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.391818 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.391970 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.392113 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.392265 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.392407 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.392548 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.392689 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.392871 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.393018 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.393160 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.393310 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.393452 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.393614 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.394446 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.394950 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.394950 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.395239 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.395382 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.395524 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.395675 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.395818 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.395961 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.396103 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.396250 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.396402 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.396552 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.396695 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.396876 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.397023 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.397176 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.397327 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.397471 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.397612 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.397753 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.397894 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.398037 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.398187 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.398330 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.398471 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.398613 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.398754 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.398894 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.399056 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.399200 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.399342 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.399490 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.399667 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.399836 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.399982 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.400125 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.400267 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.400409 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.400550 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.400704 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.400903 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.401063 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.401215 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.401359 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.401500 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.401668 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.401778 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.401865 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.401961 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.402050 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.402234 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.402334 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.402546 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.402635 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.402872 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.402968 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.403192 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.403281 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.403506 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.403595 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.403819 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.403907 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.404134 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.404221 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.404445 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.404532 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.404758 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.404865 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.405107 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.405196 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.405407 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.405494 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.405717 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.405801 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.406028 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.406113 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.406335 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.406421 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.406649 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.406743 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.406963 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.407120 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.407272 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.407528 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.407680 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.407863 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.408012 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.408179 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.408327 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.408502 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.408741 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.408947 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.409109 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.409277 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.409562 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.410078 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.410225 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.410378 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.410523 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.410523 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.410913 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.411113 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.411113 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.411442 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.411672 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.411672 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.412106 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.412333 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.412333 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.412822 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.413079 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.413322 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.413495 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.413659 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.413886 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.414118 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.414349 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.414349 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.414822 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.415070 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.415308 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.415552 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.415812 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.416051 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.416051 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.416380 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.416525 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.416668 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.416881 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.416881 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.417256 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.417498 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.417498 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.417959 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.418216 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.418415 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.418574 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.418574 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.418846 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.418846 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.419125 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.419278 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.419433 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.419584 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.419727 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.419878 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.420022 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.420022 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.420289 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.420289 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.420555 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.420555 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.420883 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.421028 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.421170 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.421334 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.421485 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.421641 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.421786 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.421927 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.422070 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.422212 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.422378 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.422579 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.422734 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.422886 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.423030 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.423181 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.423344 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.423487 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.423630 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.423772 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.423921 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.424071 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.424224 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.424369 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.424512 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.424660 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.424830 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.425969 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.426155 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.426327 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.426473 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.426616 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.426758 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.426959 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.427116 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.427280 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.427436 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.427578 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.427578 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.427863 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.428008 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.428169 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.428313 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.428456 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.428604 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.428757 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.428927 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.429084 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.429229 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.429229 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.429505 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.429657 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.429801 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.429943 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.430106 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.430250 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.430392 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.430544 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.430696 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.430839 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.430989 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.431133 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.431283 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.431427 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.431570 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.431711 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.431852 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.432004 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.432156 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.432312 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.432455 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.432598 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.432748 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.432936 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.433091 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.433243 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.433387 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.433528 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.433672 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.433813 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.433975 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.434134 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.434276 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.434427 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.434571 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.434727 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.434870 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.435018 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.435162 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.435303 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.435444 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.435595 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.435746 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.435909 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.436053 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.436194 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.436336 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.436491 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.436634 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.436821 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.436973 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.437127 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.437271 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.437495 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.437641 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.437802 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.437946 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.438096 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.438248 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.438392 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.438541 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.438683 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.438824 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.438967 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.439118 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.439262 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.439403 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.439403 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.439689 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.439833 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.439989 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.440132 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.440275 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.440416 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.440661 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.441408 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.441528 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.441602 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.441675 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.441750 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.441817 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.441892 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.441980 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.442061 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.442139 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.442139 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.442291 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.442378 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.442464 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.442543 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.442630 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.442709 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.442787 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.442878 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.442958 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.443184 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.443284 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.443511 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.443600 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.443820 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.443910 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.444135 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.444223 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.444444 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.444532 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.444751 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.444857 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.445088 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.445177 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.445400 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.445496 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.445713 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.445803 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.446022 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.446107 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.446330 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.446426 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.446642 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.446741 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.446954 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.447048 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.447265 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.447379 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.447579 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.447669 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.447891 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.447977 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.448197 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.448293 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.448516 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.448608 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.448852 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.448954 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.449163 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.449306 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.449476 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.449562 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.449781 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.449878 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.450091 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.450178 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.450394 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.450480 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.450710 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.450832 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.451025 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.451146 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.451337 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.451459 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.451651 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.451763 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.451965 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.452075 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.452280 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.452386 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.452595 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.452690 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.452928 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.453036 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.453263 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.453372 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.453576 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.453748 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.453885 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.454061 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.454201 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.454373 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.454510 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.454685 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.454825 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.454992 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.455133 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.455298 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.455568 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.455713 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.455882 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.455975 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.456226 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.456350 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.456530 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.456614 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.456882 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.457041 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.457211 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.457362 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.457519 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.457682 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.457842 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.458000 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.458259 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.458353 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.458573 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.458719 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.458879 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.459035 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.459296 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.459431 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.459610 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.459698 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.459924 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.460023 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.460236 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.460331 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.460554 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.460640 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.460907 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.460996 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.461217 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.461314 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.461525 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.461618 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.461831 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.461918 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.462153 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.462246 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.462459 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.462543 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.462778 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.462871 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.463094 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.463194 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.463405 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.463504 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.463730 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.463828 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.464055 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.464201 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.464371 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.464515 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.464694 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.464851 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.465141 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.465230 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.465468 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.465555 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.465782 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.465870 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.466105 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.466199 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.466422 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.466509 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.466727 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.466812 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.467033 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.467131 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.467347 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.467435 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.467651 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.467739 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.467958 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.468045 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.468266 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.468353 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.468577 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.468662 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.468912 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.469015 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.469227 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.469315 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.469539 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.469627 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.469845 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.470031 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.470152 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.470271 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.470475 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.470594 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.470787 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.470923 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.471109 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.471252 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.471423 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.471563 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.471764 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.471904 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.472093 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.472403 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.472539 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.472728 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.472845 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.473067 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.473165 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.473374 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.473527 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.473681 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.473776 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.473988 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.474132 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.474332 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.474456 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.474642 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.474772 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.474968 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.475082 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.475299 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.475386 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.475633 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.475729 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.475947 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.476104 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.476282 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.476369 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.476612 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.476701 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.476961 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.477050 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.477293 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.477415 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.477618 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.477707 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.477926 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.478017 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.478231 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.478317 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.478544 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.478639 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.478851 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.478938 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.479157 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.479251 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.479464 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.479589 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.479775 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.479899 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.480085 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.480216 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.480394 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.480544 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.480703 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.480896 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.481056 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.481210 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.481365 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.481548 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.481691 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.481879 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.482005 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.482457 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.482575 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.482786 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.482872 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.483114 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.483214 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.483422 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.483509 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.483729 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.483815 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.484044 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.484212 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.484354 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.484441 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.484662 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.484748 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.484996 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.485097 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.485310 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.485397 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.485617 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.485713 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.485925 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.486021 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.486231 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.486318 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.486557 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.486643 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.486867 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.486962 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.487188 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.487275 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.488017 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.488130 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.488326 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.488540 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.488632 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.488897 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.488992 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.489287 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.489440 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.489595 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.489775 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.489926 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.490098 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.490252 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.490420 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.490554 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.490746 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.490879 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.491063 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.491198 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.491381 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.491515 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.491699 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.491831 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.492015 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.492174 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.492332 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.492451 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.492646 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.492786 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.493007 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.493107 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.493337 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.493425 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.493667 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.493754 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.494007 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.494103 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.494327 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.494541 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.494650 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.494879 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.494974 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.495204 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.495290 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.495527 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.495616 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.495848 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.495943 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.496167 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.496261 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.496489 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.496577 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.496839 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.496930 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.497159 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.497257 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.497474 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.497561 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.497790 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.497884 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.498109 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.498195 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.498428 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.498516 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.498807 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.498900 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.499152 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.499239 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.499475 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.499570 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.499795 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.499889 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.500107 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.500206 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.500427 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.500526 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.500821 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.500911 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.501111 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.501197 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.501422 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.501509 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.501742 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.501829 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.502063 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.502262 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.502384 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.502581 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.502699 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.502917 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.503024 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.503844 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.503978 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.504172 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.504251 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.504488 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.504574 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.504825 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.504932 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.505148 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.505234 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.505463 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.505549 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.505775 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.505863 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.506091 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.506179 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.506405 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.506492 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.506711 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.506807 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.507038 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.507124 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.507350 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.507438 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.507657 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.507867 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.507980 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.508191 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.508277 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.508533 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.508887 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.508984 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.509219 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.509306 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.509537 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.509639 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.509857 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.509992 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.510187 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.510273 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.510501 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.510597 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.510810 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.510905 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.511124 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.511212 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.511439 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.511538 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.511744 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.511832 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.512070 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.512156 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.512383 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.512470 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.512689 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.512795 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.513038 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.513124 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.513352 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.513439 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.513666 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.513883 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.513971 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.514232 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.514326 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.514551 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.514637 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.514879 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.514966 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.515194 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.515289 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.515504 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.515599 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.515811 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.515895 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.516120 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.516206 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.516428 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.516515 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.516735 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.516859 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.517077 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.517164 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.517391 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.517477 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.517700 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.517786 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.518004 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.518098 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.518318 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.518404 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.518646 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.518735 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.518989 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.519074 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.519303 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.519391 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.519610 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.519706 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.519915 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.520040 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.520236 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.520324 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.520545 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.520643 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.520884 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.521079 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.521525 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.521610 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.521690 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.521783 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.521865 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.521943 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.522088 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.522175 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.522397 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.522629 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.522716 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.522795 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.523000 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.523086 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.523313 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.523620 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.523706 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.523937 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.524023 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.524246 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.524345 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.524560 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.524647 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.524899 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.524989 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.525228 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.525328 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.525537 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.525629 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.525848 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.525935 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.526178 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.526274 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.526497 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.526585 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.526812 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.526910 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.527128 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.527214 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.527443 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.527529 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.527755 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.527840 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.528068 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.528157 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.528385 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.528625 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.528711 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.528990 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.529092 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.529319 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.529406 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.529629 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.529715 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.529942 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.530036 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.530254 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.530351 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.530573 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.530659 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.530884 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.530977 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.531214 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.531301 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.531530 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.531615 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.531846 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.531940 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.532162 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.532249 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.532477 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.532562 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.532805 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.532895 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.533123 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.533209 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.533437 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.533537 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.533750 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.533836 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.534061 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.534155 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.534398 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.534553 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.534716 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.534802 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.535021 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.535097 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.535335 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.535446 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.535651 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.535763 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.535971 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.536087 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.536316 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.536395 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.536712 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.537021 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.537099 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.537363 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.537449 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.537685 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.537760 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.538009 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.538104 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.538321 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.538424 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.538639 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.538725 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.538958 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.539045 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.539274 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.539369 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.539599 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.539686 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.539912 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.539998 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.540222 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.540311 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.540535 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.540621 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.540882 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.540972 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.541207 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.541295 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.541517 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.541611 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.541825 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.541924 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.542131 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.542218 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.542443 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.542529 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.542748 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.542869 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.543056 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.543211 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.543364 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.543560 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.543695 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.543881 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.543969 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.544257 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.544345 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.544571 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.544657 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.544903 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.545004 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.545213 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.545300 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.545520 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.545647 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.545827 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.545983 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.546140 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.546318 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.546447 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.546677 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.546807 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.547005 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.547091 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.547341 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.547436 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.547652 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.547739 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.547988 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.548075 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.548325 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.548411 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.548644 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.548731 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.549031 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.549124 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.549300 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.549399 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.549624 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.549712 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.550467 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.550563 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.550795 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.550999 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.551130 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.551324 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.551447 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.551655 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.551748 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.551990 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.552085 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.552324 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.552412 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.552656 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.552743 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.553017 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.553147 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.553392 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.553478 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.553721 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.553816 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.554071 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.554157 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.554393 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.554488 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.554729 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.554832 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.555040 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.555126 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.555371 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.555457 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.555697 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.555805 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.556018 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.556105 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.556344 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.556430 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.556656 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.556743 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.557000 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.557088 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.557315 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.557410 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.557627 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.557716 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.557941 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.558035 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.558391 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.558834 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.558933 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.559024 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.559110 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.559190 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.559506 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.559806 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.559890 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.559957 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.560034 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.560120 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.560199 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.560285 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.560366 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.560444 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.560706 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.560841 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.561054 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.561162 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.561383 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.561470 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.561713 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.561798 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.562037 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.562141 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.562362 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.562457 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.562685 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.562771 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.563022 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.563109 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.563395 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.563479 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.563713 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.563799 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.564029 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.564117 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.564276 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 03:21:57.564361 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.564645 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.564991 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.565311 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.566251 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.566569 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.566890 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.567212 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.567545 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.567877 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.568193 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.568525 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.568880 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.569237 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.569558 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.569907 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.570241 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.570561 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.570878 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.571193 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:21:57.571440 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 03:21:57.717657 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO dbcounter [None req-818600fb-011c-4d75-8999-5ce1dc070eeb None None] Registered counter for database nova_api Aug 24 03:21:57.724295 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO dbcounter [None req-75e189b5-d8b6-465e-b5d3-9b49d2ea90eb None None] Registered counter for database nova_api Aug 24 03:21:57.740292 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG oslo_db.sqlalchemy.engines [None req-818600fb-011c-4d75-8999-5ce1dc070eeb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:21:57.744626 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG oslo_db.sqlalchemy.engines [None req-75e189b5-d8b6-465e-b5d3-9b49d2ea90eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105518) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:21:57.747025 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG dbcounter [-] [105517] Writer thread running {{(pid=105517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:21:57.751187 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG dbcounter [-] [105518] Writer thread running {{(pid=105518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:21:57.804162 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.context [None req-818600fb-011c-4d75-8999-5ce1dc070eeb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ed5b7d00-8e19-4d94-83cc-5821156784d7(cell1) {{(pid=105517) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 03:21:57.807982 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG oslo_concurrency.lockutils [None req-818600fb-011c-4d75-8999-5ce1dc070eeb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:21:57.808463 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG oslo_concurrency.lockutils [None req-818600fb-011c-4d75-8999-5ce1dc070eeb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:21:57.808580 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.context [None req-75e189b5-d8b6-465e-b5d3-9b49d2ea90eb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ed5b7d00-8e19-4d94-83cc-5821156784d7(cell1) {{(pid=105518) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 03:21:57.810066 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG oslo_concurrency.lockutils [None req-818600fb-011c-4d75-8999-5ce1dc070eeb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:21:57.810813 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG oslo_concurrency.lockutils [None req-818600fb-011c-4d75-8999-5ce1dc070eeb None None] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:21:57.811265 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG oslo_concurrency.lockutils [None req-818600fb-011c-4d75-8999-5ce1dc070eeb None None] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:21:57.812458 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG oslo_concurrency.lockutils [None req-75e189b5-d8b6-465e-b5d3-9b49d2ea90eb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:21:57.812960 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG oslo_concurrency.lockutils [None req-75e189b5-d8b6-465e-b5d3-9b49d2ea90eb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:21:57.813272 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG oslo_concurrency.lockutils [None req-818600fb-011c-4d75-8999-5ce1dc070eeb None None] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:21:57.814541 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG oslo_concurrency.lockutils [None req-75e189b5-d8b6-465e-b5d3-9b49d2ea90eb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:21:57.815223 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO dbcounter [None req-818600fb-011c-4d75-8999-5ce1dc070eeb None None] Registered counter for database nova_cell0 Aug 24 03:21:57.815323 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG oslo_concurrency.lockutils [None req-75e189b5-d8b6-465e-b5d3-9b49d2ea90eb None None] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:21:57.815815 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG oslo_concurrency.lockutils [None req-75e189b5-d8b6-465e-b5d3-9b49d2ea90eb None None] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:21:57.817827 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG oslo_concurrency.lockutils [None req-75e189b5-d8b6-465e-b5d3-9b49d2ea90eb None None] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:21:57.819783 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO dbcounter [None req-75e189b5-d8b6-465e-b5d3-9b49d2ea90eb None None] Registered counter for database nova_cell0 Aug 24 03:21:57.820986 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO dbcounter [None req-818600fb-011c-4d75-8999-5ce1dc070eeb None None] Registered counter for database nova_cell1 Aug 24 03:21:57.825178 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO dbcounter [None req-75e189b5-d8b6-465e-b5d3-9b49d2ea90eb None None] Registered counter for database nova_cell1 Aug 24 03:21:57.828279 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG oslo_db.sqlalchemy.engines [None req-818600fb-011c-4d75-8999-5ce1dc070eeb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:21:57.830770 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG oslo_db.sqlalchemy.engines [None req-818600fb-011c-4d75-8999-5ce1dc070eeb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:21:57.832565 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG oslo_db.sqlalchemy.engines [None req-75e189b5-d8b6-465e-b5d3-9b49d2ea90eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105518) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:21:57.837443 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG dbcounter [-] [105518] Writer thread running {{(pid=105518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:21:57.837803 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG dbcounter [-] [105517] Writer thread running {{(pid=105517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:21:57.838146 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG dbcounter [-] [105517] Writer thread running {{(pid=105517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:21:57.838950 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG oslo_db.sqlalchemy.engines [None req-75e189b5-d8b6-465e-b5d3-9b49d2ea90eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105518) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:21:57.985387 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO dbcounter [None req-818600fb-011c-4d75-8999-5ce1dc070eeb None None] Registered counter for database nova_cell0 Aug 24 03:21:57.989749 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG dbcounter [-] [105518] Writer thread running {{(pid=105518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:21:57.994213 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG oslo_db.sqlalchemy.engines [None req-818600fb-011c-4d75-8999-5ce1dc070eeb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:21:57.998548 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO dbcounter [None req-75e189b5-d8b6-465e-b5d3-9b49d2ea90eb None None] Registered counter for database nova_cell0 Aug 24 03:21:57.998667 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG dbcounter [-] [105517] Writer thread running {{(pid=105517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:21:58.005780 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG oslo_db.sqlalchemy.engines [None req-75e189b5-d8b6-465e-b5d3-9b49d2ea90eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105518) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:21:58.010313 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG dbcounter [-] [105518] Writer thread running {{(pid=105518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:21:58.338991 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: WARNING keystonemiddleware.auth_token [None req-818600fb-011c-4d75-8999-5ce1dc070eeb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:21:58.341916 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: WARNING keystonemiddleware.auth_token [None req-75e189b5-d8b6-465e-b5d3-9b49d2ea90eb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:21:58.346291 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: WARNING keystonemiddleware.auth_token [None req-818600fb-011c-4d75-8999-5ce1dc070eeb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:21:58.349825 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: WARNING keystonemiddleware.auth_token [None req-75e189b5-d8b6-465e-b5d3-9b49d2ea90eb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:21:58.689689 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: WARNING keystonemiddleware.auth_token [None req-818600fb-011c-4d75-8999-5ce1dc070eeb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:21:58.697186 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: WARNING keystonemiddleware.auth_token [None req-818600fb-011c-4d75-8999-5ce1dc070eeb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:21:58.697305 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: WARNING keystonemiddleware.auth_token [None req-75e189b5-d8b6-465e-b5d3-9b49d2ea90eb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:21:58.702431 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56454ea0b9c0 pid: 105517 (default app) Aug 24 03:21:58.703141 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: WARNING keystonemiddleware.auth_token [None req-75e189b5-d8b6-465e-b5d3-9b49d2ea90eb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:21:58.704522 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-818600fb-011c-4d75-8999-5ce1dc070eeb None None] Calling method '>' {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:21:58.705760 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-818600fb-011c-4d75-8999-5ce1dc070eeb None None] 10.222.0.81 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001795 Aug 24 03:21:58.706183 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 1/1] 10.222.0.81 () {50 vars in 788 bytes} [Wed Aug 24 03:21:58 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:21:58.709212 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56454ea0b9c0 pid: 105518 (default app) Aug 24 03:23:17.594100 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-818600fb-011c-4d75-8999-5ce1dc070eeb None None] Calling method '>' {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:23:17.595724 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-818600fb-011c-4d75-8999-5ce1dc070eeb None None] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002120 Aug 24 03:23:17.596116 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 2/2] 10.222.0.81 () {54 vars in 931 bytes} [Wed Aug 24 03:23:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:23:17.609426 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG dbcounter [-] [105518] Writing DB stats nova_api:SELECT=3 {{(pid=105518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:23:17.610273 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG dbcounter [-] [105518] Writing DB stats nova_cell0:SELECT=3 {{(pid=105518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:23:17.611333 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG dbcounter [-] [105518] Writing DB stats nova_cell1:SELECT=3 {{(pid=105518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:23:17.612383 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG dbcounter [-] [105518] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:23:18.522281 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-305f93a4-44df-4f0e-87de-03d2ca942f67 admin admin] Calling method '>' {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:23:18.555374 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-305f93a4-44df-4f0e-87de-03d2ca942f67 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.952170 Aug 24 03:23:18.556256 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 1/3] 10.222.0.81 () {60 vars in 1292 bytes} [Wed Aug 24 03:23:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:23:20.989433 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-818600fb-011c-4d75-8999-5ce1dc070eeb None None] Calling method '>' {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:23:20.990425 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-818600fb-011c-4d75-8999-5ce1dc070eeb None None] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 24 03:23:20.990981 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 3/4] 10.222.0.81 () {54 vars in 931 bytes} [Wed Aug 24 03:23:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:23:21.416114 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-2a0e00de-f925-478e-b827-10b44c63e09b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "cirros256", "disk": 1, "swap": 0, "ram": 256, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "os-flavor-access:is_public": true}} {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:23:21.439807 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:23:21.439807 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: warnings.warn(msg) Aug 24 03:23:21.469503 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-2a0e00de-f925-478e-b827-10b44c63e09b admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.471469 Aug 24 03:23:21.470463 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 2/5] 10.222.0.81 () {64 vars in 1283 bytes} [Wed Aug 24 03:23:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:23:21.690264 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-7616d568-b3d4-43d0-b2c2-9c83a47b1fc6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:23:21.695474 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:23:21.695474 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: warnings.warn(msg) Aug 24 03:23:21.697485 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG dbcounter [-] [105517] Writing DB stats nova_api:SELECT=3 {{(pid=105517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:23:21.699436 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG dbcounter [-] [105517] Writing DB stats nova_cell1:SELECT=3 {{(pid=105517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:23:21.699436 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG dbcounter [-] [105517] Writing DB stats nova_cell0:SELECT=3 {{(pid=105517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:23:21.700022 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG dbcounter [-] [105517] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:23:21.760309 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-7616d568-b3d4-43d0-b2c2-9c83a47b1fc6 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282011 Aug 24 03:23:21.761090 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 4/6] 10.222.0.81 () {64 vars in 1336 bytes} [Wed Aug 24 03:23:21 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:23:24.188165 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-2a0e00de-f925-478e-b827-10b44c63e09b admin admin] Calling method '>' {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:23:24.189233 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-2a0e00de-f925-478e-b827-10b44c63e09b admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Aug 24 03:23:24.189627 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 3/7] 10.222.0.81 () {54 vars in 931 bytes} [Wed Aug 24 03:23:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:23:24.861581 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-b123b318-acd0-4d60-b526-017fd399583b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "name": "ds512M", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "ram": 512}} {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:23:24.882027 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:23:24.882027 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: warnings.warn(msg) Aug 24 03:23:24.903541 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-b123b318-acd0-4d60-b526-017fd399583b admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.707655 Aug 24 03:23:24.904350 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 5/8] 10.222.0.81 () {64 vars in 1283 bytes} [Wed Aug 24 03:23:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:23:24.919542 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-0c0a0754-579e-4010-96a2-64f00bc9e766 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:23:24.922869 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:23:24.922869 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: warnings.warn(msg) Aug 24 03:23:24.957440 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-0c0a0754-579e-4010-96a2-64f00bc9e766 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044743 Aug 24 03:23:24.958368 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 4/9] 10.222.0.81 () {64 vars in 1336 bytes} [Wed Aug 24 03:23:24 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:23:27.361471 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-b123b318-acd0-4d60-b526-017fd399583b admin admin] Calling method '>' {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:23:27.362643 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-b123b318-acd0-4d60-b526-017fd399583b admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001649 Aug 24 03:23:27.363055 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 6/10] 10.222.0.81 () {54 vars in 931 bytes} [Wed Aug 24 03:23:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:23:27.777089 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-25dff8ee-2ce8-46bb-916f-f0dd7e921ae3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d2", "ram": 1024, "vcpus": 1, "name": "ds1G", "disk": 10, "rxtx_factor": 1.0, "swap": 0}} {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:23:27.797225 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-25dff8ee-2ce8-46bb-916f-f0dd7e921ae3 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.426858 Aug 24 03:23:27.797938 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 5/11] 10.222.0.81 () {64 vars in 1283 bytes} [Wed Aug 24 03:23:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:23:27.810843 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-640f90e4-902e-4212-bacf-b9befaebbe8c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:23:27.834029 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-640f90e4-902e-4212-bacf-b9befaebbe8c admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028024 Aug 24 03:23:27.834601 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 7/12] 10.222.0.81 () {64 vars in 1336 bytes} [Wed Aug 24 03:23:27 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:23:30.253204 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-25dff8ee-2ce8-46bb-916f-f0dd7e921ae3 admin admin] Calling method '>' {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:23:30.254227 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-25dff8ee-2ce8-46bb-916f-f0dd7e921ae3 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Aug 24 03:23:30.254619 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 6/13] 10.222.0.81 () {54 vars in 931 bytes} [Wed Aug 24 03:23:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:23:30.735009 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-0b21e3b4-0af3-4221-9ac6-1063fce22727 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "d3", "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "name": "ds2G"}} {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:23:30.755495 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-0b21e3b4-0af3-4221-9ac6-1063fce22727 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.494123 Aug 24 03:23:30.756056 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 8/14] 10.222.0.81 () {64 vars in 1283 bytes} [Wed Aug 24 03:23:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:23:30.768934 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-66bbf548-21a1-4845-b6c0-49fb149f89e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:23:30.794255 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-66bbf548-21a1-4845-b6c0-49fb149f89e9 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029027 Aug 24 03:23:30.802151 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 7/15] 10.222.0.81 () {64 vars in 1336 bytes} [Wed Aug 24 03:23:30 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:23:33.186520 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-0b21e3b4-0af3-4221-9ac6-1063fce22727 admin admin] Calling method '>' {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:23:33.188257 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-0b21e3b4-0af3-4221-9ac6-1063fce22727 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002116 Aug 24 03:23:33.189022 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 9/16] 10.222.0.81 () {54 vars in 931 bytes} [Wed Aug 24 03:23:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:23:33.651753 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-f75063a9-8ff2-4d86-8020-fa2df9e4e4c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "ram": 4096, "disk": 20}} {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:23:33.673133 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-f75063a9-8ff2-4d86-8020-fa2df9e4e4c5 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.477623 Aug 24 03:23:33.673903 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 8/17] 10.222.0.81 () {64 vars in 1283 bytes} [Wed Aug 24 03:23:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:23:33.686267 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-ae883f33-b8c7-40d3-a791-e0f466e16361 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:23:33.711942 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-ae883f33-b8c7-40d3-a791-e0f466e16361 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029711 Aug 24 03:23:33.713211 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 10/18] 10.222.0.81 () {64 vars in 1336 bytes} [Wed Aug 24 03:23:33 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:23:36.066674 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-f75063a9-8ff2-4d86-8020-fa2df9e4e4c5 admin admin] Calling method '>' {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:23:36.067684 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-f75063a9-8ff2-4d86-8020-fa2df9e4e4c5 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 24 03:23:36.068137 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 9/19] 10.222.0.81 () {54 vars in 931 bytes} [Wed Aug 24 03:23:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:23:36.502202 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-88862446-5a4f-46f9-a54f-6cabfd1443e0 admin admin] Calling method '>' {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:23:36.526158 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-88862446-5a4f-46f9-a54f-6cabfd1443e0 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.451326 Aug 24 03:23:36.527316 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 11/20] 10.222.0.81 () {60 vars in 1292 bytes} [Wed Aug 24 03:23:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:23:38.909127 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-f75063a9-8ff2-4d86-8020-fa2df9e4e4c5 admin admin] Calling method '>' {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:23:38.910033 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-f75063a9-8ff2-4d86-8020-fa2df9e4e4c5 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 24 03:23:38.910415 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 10/21] 10.222.0.81 () {54 vars in 931 bytes} [Wed Aug 24 03:23:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:23:39.327329 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-c393f715-26f1-49c5-beee-896dae396610 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "swap": 0, "id": "1", "vcpus": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512}} {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:23:39.347451 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-c393f715-26f1-49c5-beee-896dae396610 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.428584 Aug 24 03:23:39.347939 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 12/22] 10.222.0.81 () {64 vars in 1283 bytes} [Wed Aug 24 03:23:38 2022] POST /compute/v2.1/flavors => generated 402 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:23:39.360434 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-eb6989e9-692b-4c7b-8e08-26e898af1473 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:23:39.386251 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-eb6989e9-692b-4c7b-8e08-26e898af1473 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029470 Aug 24 03:23:39.386910 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 11/23] 10.222.0.81 () {64 vars in 1333 bytes} [Wed Aug 24 03:23:39 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:23:41.975534 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-c393f715-26f1-49c5-beee-896dae396610 admin admin] Calling method '>' {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:23:41.976552 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-c393f715-26f1-49c5-beee-896dae396610 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 24 03:23:41.976992 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 13/24] 10.222.0.81 () {54 vars in 931 bytes} [Wed Aug 24 03:23:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:23:42.380871 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-d6cb37b1-3b6f-4047-99b0-1cad4972df38 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 2048, "disk": 20, "vcpus": 1, "id": "2", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:23:42.400933 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-d6cb37b1-3b6f-4047-99b0-1cad4972df38 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.417026 Aug 24 03:23:42.401505 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 12/25] 10.222.0.81 () {64 vars in 1283 bytes} [Wed Aug 24 03:23:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:23:42.413268 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-53a77c46-ea76-41bc-9f2e-6b050e3f7bbd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:23:42.437212 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-53a77c46-ea76-41bc-9f2e-6b050e3f7bbd admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027517 Aug 24 03:23:42.437751 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 14/26] 10.222.0.81 () {64 vars in 1333 bytes} [Wed Aug 24 03:23:42 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:23:44.849596 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-d6cb37b1-3b6f-4047-99b0-1cad4972df38 admin admin] Calling method '>' {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:23:44.851301 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-d6cb37b1-3b6f-4047-99b0-1cad4972df38 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002187 Aug 24 03:23:44.851927 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 13/27] 10.222.0.81 () {54 vars in 931 bytes} [Wed Aug 24 03:23:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:23:45.286838 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-4c4f9354-aa66-4403-9209-fe3dc1266aba admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "id": "3", "name": "m1.medium", "swap": 0, "vcpus": 2}} {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:23:45.308491 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-4c4f9354-aa66-4403-9209-fe3dc1266aba admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.450365 Aug 24 03:23:45.309394 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 15/28] 10.222.0.81 () {64 vars in 1283 bytes} [Wed Aug 24 03:23:44 2022] POST /compute/v2.1/flavors => generated 406 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:23:45.321466 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-80ff667e-d141-4945-9ad8-5dc9f46121a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:23:45.346806 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-80ff667e-d141-4945-9ad8-5dc9f46121a3 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029293 Aug 24 03:23:45.348133 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 14/29] 10.222.0.81 () {64 vars in 1333 bytes} [Wed Aug 24 03:23:45 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:23:47.787936 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-4c4f9354-aa66-4403-9209-fe3dc1266aba admin admin] Calling method '>' {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:23:47.788960 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-4c4f9354-aa66-4403-9209-fe3dc1266aba admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 24 03:23:47.789596 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 16/30] 10.222.0.81 () {54 vars in 931 bytes} [Wed Aug 24 03:23:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:23:48.259653 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-660ade08-4cc7-4e61-abd0-847ff17c8c00 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "os-flavor-access:is_public": true, "swap": 0, "id": "4", "name": "m1.large", "rxtx_factor": 1.0, "ram": 8192, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:23:48.266996 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG dbcounter [-] [105518] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:23:48.281836 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-660ade08-4cc7-4e61-abd0-847ff17c8c00 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.484155 Aug 24 03:23:48.282685 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 15/31] 10.222.0.81 () {64 vars in 1283 bytes} [Wed Aug 24 03:23:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:23:48.295303 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-e9212eaf-6f32-4740-b899-3dee7090b093 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:23:48.325895 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-e9212eaf-6f32-4740-b899-3dee7090b093 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034486 Aug 24 03:23:48.326823 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 17/32] 10.222.0.81 () {64 vars in 1333 bytes} [Wed Aug 24 03:23:48 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:23:50.742954 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-660ade08-4cc7-4e61-abd0-847ff17c8c00 admin admin] Calling method '>' {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:23:50.744176 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-660ade08-4cc7-4e61-abd0-847ff17c8c00 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001805 Aug 24 03:23:50.745038 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 16/33] 10.222.0.81 () {54 vars in 931 bytes} [Wed Aug 24 03:23:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:23:51.210283 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-29f13dc3-cfbc-4323-852f-a35546836cf7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "disk": 160, "id": "5", "ram": 16384, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.xlarge"}} {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:23:51.230731 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-29f13dc3-cfbc-4323-852f-a35546836cf7 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.479398 Aug 24 03:23:51.231398 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 18/34] 10.222.0.81 () {64 vars in 1283 bytes} [Wed Aug 24 03:23:50 2022] POST /compute/v2.1/flavors => generated 408 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:23:51.244203 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-056a2717-b90a-44ba-977a-958b61cd4885 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:23:51.272290 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-056a2717-b90a-44ba-977a-958b61cd4885 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032042 Aug 24 03:23:51.272889 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 17/35] 10.222.0.81 () {64 vars in 1333 bytes} [Wed Aug 24 03:23:51 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:24:10.120540 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-29f13dc3-cfbc-4323-852f-a35546836cf7 admin admin] Calling method '>' {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:10.121580 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-29f13dc3-cfbc-4323-852f-a35546836cf7 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 24 03:24:10.121981 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 19/36] 10.222.0.81 () {54 vars in 931 bytes} [Wed Aug 24 03:24:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:24:10.133435 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG dbcounter [-] [105518] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:10.515410 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-d676406b-552b-4534-8ed2-4c0126286ac8 admin admin] Calling method '>' {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:10.534011 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-d676406b-552b-4534-8ed2-4c0126286ac8 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.406136 Aug 24 03:24:10.534568 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 18/37] 10.222.0.81 () {60 vars in 1292 bytes} [Wed Aug 24 03:24:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:24:11.606052 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-29f13dc3-cfbc-4323-852f-a35546836cf7 admin admin] Calling method '>' {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:11.607049 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-29f13dc3-cfbc-4323-852f-a35546836cf7 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 24 03:24:11.607441 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 20/38] 10.222.0.81 () {56 vars in 1074 bytes} [Wed Aug 24 03:24:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:24:12.138745 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-aeeefd03-5fe6-4864-a436-9a4b23eff8a3 admin admin] Calling method '>' {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:12.144328 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.wsgi [None req-aeeefd03-5fe6-4864-a436-9a4b23eff8a3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 03:24:12.148222 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-aeeefd03-5fe6-4864-a436-9a4b23eff8a3 admin admin] Request method failure captured: Aug 24 03:24:12.148222 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 03:24:12.148222 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: Accept: application/json Aug 24 03:24:12.148222 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: Accept-Encoding: gzip, deflate Aug 24 03:24:12.148222 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: Connection: keep-alive Aug 24 03:24:12.148222 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: Content-Length: 0 Aug 24 03:24:12.148222 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: Host: 10.222.0.81 Aug 24 03:24:12.148222 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: Openstack-Api-Version: compute 2.90 Aug 24 03:24:12.148222 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: Openstack-System-Scope: None Aug 24 03:24:12.148222 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: User-Agent: python-novaclient Aug 24 03:24:12.148222 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Auth-Token: gAAAAABjBZnbJPm7sKD8Bjyfqfu1MNWoSdhwPLhHzDb3ef88TvXbpRjxrGKqKOp9DdIppOdqGAChIJRSEAiUedXU3zDDdWg2v_HloE8K7adyLFmI2d1HpDi_jR5ZT6y_HVbvAGEpKPfzRlanH7_V098S2SbLG8K2ir5glucYqmiXyw8GuM4C5bE Aug 24 03:24:12.148222 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Domain-Id: None Aug 24 03:24:12.148222 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Domain-Name: None Aug 24 03:24:12.148222 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Identity-Status: Confirmed Aug 24 03:24:12.148222 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Is-Admin-Project: True Aug 24 03:24:12.148222 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 03:24:12.148222 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Project-Domain-Id: default Aug 24 03:24:12.148222 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Project-Domain-Name: Default Aug 24 03:24:12.148222 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Project-Id: 35c28eab9a294b9ba17b7f5b9c24d868 Aug 24 03:24:12.148222 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Project-Name: admin Aug 24 03:24:12.148222 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Role: reader,member,admin Aug 24 03:24:12.148222 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Roles: reader,member,admin Aug 24 03:24:12.149710 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/35c28eab9a294b9ba17b7f5b9c24d868"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_35c28eab9a294b9ba17b7f5b9c24d868", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/35c28eab9a294b9ba17b7f5b9c24d868"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/35c28eab9a294b9ba17b7f5b9c24d868"}]}] Aug 24 03:24:12.149710 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Tenant: admin Aug 24 03:24:12.149710 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Tenant-Id: 35c28eab9a294b9ba17b7f5b9c24d868 Aug 24 03:24:12.149710 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Tenant-Name: admin Aug 24 03:24:12.149710 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-User: admin Aug 24 03:24:12.149710 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-User-Domain-Id: default Aug 24 03:24:12.149710 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-User-Domain-Name: Default Aug 24 03:24:12.149710 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-User-Id: 5a8025e93c084f56aeda2462957536b8 Aug 24 03:24:12.149710 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-User-Name: admin Aug 24 03:24:12.149710 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: method: > Aug 24 03:24:12.149710 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: exception: Flavor 42 could not be found. Aug 24 03:24:12.149710 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: action_args: {'id': '42'} Aug 24 03:24:12.149710 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:24:12.149710 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:24:12.150557 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 03:24:12.150557 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 03:24:12.150557 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:24:12.150557 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:24:12.150557 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:24:12.150557 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:24:12.150557 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:24:12.150557 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:24:12.150557 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:24:12.150557 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:24:12.150557 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:24:12.150557 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:24:12.150557 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 03:24:12.150557 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi Aug 24 03:24:12.150557 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:24:12.150557 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi Aug 24 03:24:12.150557 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:24:12.150557 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:24:12.150557 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:24:12.151912 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:24:12.151912 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:24:12.151912 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:24:12.151912 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:24:12.151912 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 03:24:12.151912 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:24:12.151912 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 03:24:12.151912 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi Aug 24 03:24:12.151912 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:24:12.151912 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi Aug 24 03:24:12.151912 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:24:12.151912 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:24:12.151912 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:24:12.151912 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:24:12.151912 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:24:12.151912 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 03:24:12.151912 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi Aug 24 03:24:12.151912 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-aeeefd03-5fe6-4864-a436-9a4b23eff8a3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:24:12.153463 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-aeeefd03-5fe6-4864-a436-9a4b23eff8a3 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.401989 Aug 24 03:24:12.153463 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 19/39] 10.222.0.81 () {60 vars in 1190 bytes} [Wed Aug 24 03:24:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 03:24:12.159307 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-56ab60f9-bd0d-4104-b487-fb16a2536319 admin admin] Calling method '>' {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:12.164077 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG dbcounter [-] [105517] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:12.184037 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-56ab60f9-bd0d-4104-b487-fb16a2536319 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028267 Aug 24 03:24:12.184575 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 21/40] 10.222.0.81 () {60 vars in 1210 bytes} [Wed Aug 24 03:24:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:24:12.194848 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-e23d2afe-3356-4700-a7e5-14afdc776e49 admin admin] Calling method '>' {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:12.218565 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-e23d2afe-3356-4700-a7e5-14afdc776e49 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027757 Aug 24 03:24:12.219097 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 20/41] 10.222.0.81 () {60 vars in 1210 bytes} [Wed Aug 24 03:24:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:24:12.229954 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-f0c26cc5-c3d6-4c49-a44d-13446fefc68f admin admin] Calling method '>' {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:12.236569 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.wsgi [None req-f0c26cc5-c3d6-4c49-a44d-13446fefc68f admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 03:24:12.240643 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-f0c26cc5-c3d6-4c49-a44d-13446fefc68f admin admin] Request method failure captured: Aug 24 03:24:12.240643 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 03:24:12.240643 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: Accept: application/json Aug 24 03:24:12.240643 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: Accept-Encoding: gzip, deflate Aug 24 03:24:12.240643 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: Connection: keep-alive Aug 24 03:24:12.240643 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: Content-Length: 0 Aug 24 03:24:12.240643 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: Host: 10.222.0.81 Aug 24 03:24:12.240643 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: Openstack-Api-Version: compute 2.90 Aug 24 03:24:12.240643 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: Openstack-System-Scope: None Aug 24 03:24:12.240643 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: User-Agent: python-novaclient Aug 24 03:24:12.240643 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Auth-Token: gAAAAABjBZnbJPm7sKD8Bjyfqfu1MNWoSdhwPLhHzDb3ef88TvXbpRjxrGKqKOp9DdIppOdqGAChIJRSEAiUedXU3zDDdWg2v_HloE8K7adyLFmI2d1HpDi_jR5ZT6y_HVbvAGEpKPfzRlanH7_V098S2SbLG8K2ir5glucYqmiXyw8GuM4C5bE Aug 24 03:24:12.240643 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Domain-Id: None Aug 24 03:24:12.240643 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Domain-Name: None Aug 24 03:24:12.240643 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Identity-Status: Confirmed Aug 24 03:24:12.240643 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Is-Admin-Project: True Aug 24 03:24:12.240643 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 03:24:12.240643 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Project-Domain-Id: default Aug 24 03:24:12.240643 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Project-Domain-Name: Default Aug 24 03:24:12.240643 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Project-Id: 35c28eab9a294b9ba17b7f5b9c24d868 Aug 24 03:24:12.240643 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Project-Name: admin Aug 24 03:24:12.240643 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Role: reader,member,admin Aug 24 03:24:12.240643 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Roles: reader,member,admin Aug 24 03:24:12.242193 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/35c28eab9a294b9ba17b7f5b9c24d868"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_35c28eab9a294b9ba17b7f5b9c24d868", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/35c28eab9a294b9ba17b7f5b9c24d868"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/35c28eab9a294b9ba17b7f5b9c24d868"}]}] Aug 24 03:24:12.242193 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Tenant: admin Aug 24 03:24:12.242193 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Tenant-Id: 35c28eab9a294b9ba17b7f5b9c24d868 Aug 24 03:24:12.242193 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Tenant-Name: admin Aug 24 03:24:12.242193 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-User: admin Aug 24 03:24:12.242193 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-User-Domain-Id: default Aug 24 03:24:12.242193 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-User-Domain-Name: Default Aug 24 03:24:12.242193 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-User-Id: 5a8025e93c084f56aeda2462957536b8 Aug 24 03:24:12.242193 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-User-Name: admin Aug 24 03:24:12.242193 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: method: > Aug 24 03:24:12.242193 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: exception: Flavor 42 could not be found. Aug 24 03:24:12.242193 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: action_args: {'id': '42'} Aug 24 03:24:12.242193 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:24:12.242193 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:24:12.243051 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 03:24:12.243051 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 03:24:12.243051 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:24:12.243051 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:24:12.243051 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:24:12.243051 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:24:12.243051 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:24:12.243051 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:24:12.243051 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:24:12.243051 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:24:12.243051 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:24:12.243051 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:24:12.243051 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 03:24:12.243051 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi Aug 24 03:24:12.243051 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:24:12.243051 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi Aug 24 03:24:12.243051 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:24:12.243051 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:24:12.243051 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:24:12.244188 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:24:12.244188 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:24:12.244188 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:24:12.244188 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:24:12.244188 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 03:24:12.244188 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:24:12.244188 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 03:24:12.244188 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi Aug 24 03:24:12.244188 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:24:12.244188 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi Aug 24 03:24:12.244188 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:24:12.244188 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:24:12.244188 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:24:12.244188 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:24:12.244188 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:24:12.244188 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 03:24:12.244188 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi Aug 24 03:24:12.244188 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-f0c26cc5-c3d6-4c49-a44d-13446fefc68f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:24:12.245416 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-f0c26cc5-c3d6-4c49-a44d-13446fefc68f admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016327 Aug 24 03:24:12.245416 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 22/42] 10.222.0.81 () {60 vars in 1190 bytes} [Wed Aug 24 03:24:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 03:24:13.235928 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-e23d2afe-3356-4700-a7e5-14afdc776e49 admin admin] Calling method '>' {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:13.237250 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-e23d2afe-3356-4700-a7e5-14afdc776e49 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001716 Aug 24 03:24:13.237639 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 21/43] 10.222.0.81 () {56 vars in 1074 bytes} [Wed Aug 24 03:24:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:24:13.769775 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-f0c3fe65-2bd7-4458-a21b-8d3f3c641eeb admin admin] Calling method '>' {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:13.775690 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.wsgi [None req-f0c3fe65-2bd7-4458-a21b-8d3f3c641eeb admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 03:24:13.777235 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-f0c3fe65-2bd7-4458-a21b-8d3f3c641eeb admin admin] Request method failure captured: Aug 24 03:24:13.777235 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 03:24:13.777235 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: Accept: application/json Aug 24 03:24:13.777235 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: Accept-Encoding: gzip, deflate Aug 24 03:24:13.777235 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: Connection: keep-alive Aug 24 03:24:13.777235 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: Content-Length: 0 Aug 24 03:24:13.777235 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: Host: 10.222.0.81 Aug 24 03:24:13.777235 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: Openstack-Api-Version: compute 2.90 Aug 24 03:24:13.777235 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: Openstack-System-Scope: None Aug 24 03:24:13.777235 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: User-Agent: python-novaclient Aug 24 03:24:13.777235 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Auth-Token: gAAAAABjBZndnDwVNQLBG3Ba1A-WM-Xks-fwys4GiMFAKutlAyjWGLVoRfwjCY2z9e3wySYwO_SwatudTAaPt-BmpRI9kueOTSmrysl0H8pjPMMvkiMg86rpfUnULrp10GVdAgsBU4F6VPuo36V5wNF8Kk7OQF90sv8kvfGD0lfnJqjcCnFn5Do Aug 24 03:24:13.777235 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Domain-Id: None Aug 24 03:24:13.777235 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Domain-Name: None Aug 24 03:24:13.777235 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Identity-Status: Confirmed Aug 24 03:24:13.777235 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Is-Admin-Project: True Aug 24 03:24:13.777235 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 03:24:13.777235 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Project-Domain-Id: default Aug 24 03:24:13.777235 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Project-Domain-Name: Default Aug 24 03:24:13.777235 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Project-Id: 35c28eab9a294b9ba17b7f5b9c24d868 Aug 24 03:24:13.777235 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Project-Name: admin Aug 24 03:24:13.777235 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Role: reader,member,admin Aug 24 03:24:13.777235 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Roles: reader,member,admin Aug 24 03:24:13.778827 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/35c28eab9a294b9ba17b7f5b9c24d868"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_35c28eab9a294b9ba17b7f5b9c24d868", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/35c28eab9a294b9ba17b7f5b9c24d868"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/35c28eab9a294b9ba17b7f5b9c24d868"}]}] Aug 24 03:24:13.778827 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Tenant: admin Aug 24 03:24:13.778827 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Tenant-Id: 35c28eab9a294b9ba17b7f5b9c24d868 Aug 24 03:24:13.778827 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Tenant-Name: admin Aug 24 03:24:13.778827 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-User: admin Aug 24 03:24:13.778827 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-User-Domain-Id: default Aug 24 03:24:13.778827 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-User-Domain-Name: Default Aug 24 03:24:13.778827 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-User-Id: 5a8025e93c084f56aeda2462957536b8 Aug 24 03:24:13.778827 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-User-Name: admin Aug 24 03:24:13.778827 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: method: > Aug 24 03:24:13.778827 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: exception: Flavor 84 could not be found. Aug 24 03:24:13.778827 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: action_args: {'id': '84'} Aug 24 03:24:13.778827 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:24:13.778827 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:24:13.779734 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 03:24:13.779734 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 03:24:13.779734 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:24:13.779734 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:24:13.779734 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:24:13.779734 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:24:13.779734 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:24:13.779734 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:24:13.779734 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:24:13.779734 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:24:13.779734 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:24:13.779734 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:24:13.779734 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 03:24:13.779734 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi Aug 24 03:24:13.779734 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:24:13.779734 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi Aug 24 03:24:13.779734 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:24:13.779734 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:24:13.779734 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:24:13.780906 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:24:13.780906 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:24:13.780906 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:24:13.780906 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:24:13.780906 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 03:24:13.780906 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:24:13.780906 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 03:24:13.780906 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi Aug 24 03:24:13.780906 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:24:13.780906 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi Aug 24 03:24:13.780906 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:24:13.780906 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:24:13.780906 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:24:13.780906 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:24:13.780906 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:24:13.780906 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 03:24:13.780906 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi Aug 24 03:24:13.780906 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-f0c3fe65-2bd7-4458-a21b-8d3f3c641eeb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:24:13.781922 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-f0c3fe65-2bd7-4458-a21b-8d3f3c641eeb admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.399227 Aug 24 03:24:13.781922 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 23/44] 10.222.0.81 () {60 vars in 1190 bytes} [Wed Aug 24 03:24:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:24:13.789116 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-eb1139c0-3f0d-43af-89e9-a14ef8a58f8e admin admin] Calling method '>' {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:13.804585 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-eb1139c0-3f0d-43af-89e9-a14ef8a58f8e admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019235 Aug 24 03:24:13.805143 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 22/45] 10.222.0.81 () {60 vars in 1210 bytes} [Wed Aug 24 03:24:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:24:13.815625 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-521ae6b3-b3a9-49a5-b1c8-e81d65de1d0d admin admin] Calling method '>' {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:13.832493 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-521ae6b3-b3a9-49a5-b1c8-e81d65de1d0d admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020346 Aug 24 03:24:13.833098 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 24/46] 10.222.0.81 () {60 vars in 1210 bytes} [Wed Aug 24 03:24:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:24:13.842628 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-5f86876b-37f1-4ba7-b334-cc2e868bb9ee admin admin] Calling method '>' {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:13.847986 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.wsgi [None req-5f86876b-37f1-4ba7-b334-cc2e868bb9ee admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 03:24:13.850248 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-5f86876b-37f1-4ba7-b334-cc2e868bb9ee admin admin] Request method failure captured: Aug 24 03:24:13.850248 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 03:24:13.850248 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: Accept: application/json Aug 24 03:24:13.850248 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: Accept-Encoding: gzip, deflate Aug 24 03:24:13.850248 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: Connection: keep-alive Aug 24 03:24:13.850248 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: Content-Length: 0 Aug 24 03:24:13.850248 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: Host: 10.222.0.81 Aug 24 03:24:13.850248 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: Openstack-Api-Version: compute 2.90 Aug 24 03:24:13.850248 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: Openstack-System-Scope: None Aug 24 03:24:13.850248 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: User-Agent: python-novaclient Aug 24 03:24:13.850248 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Auth-Token: gAAAAABjBZndnDwVNQLBG3Ba1A-WM-Xks-fwys4GiMFAKutlAyjWGLVoRfwjCY2z9e3wySYwO_SwatudTAaPt-BmpRI9kueOTSmrysl0H8pjPMMvkiMg86rpfUnULrp10GVdAgsBU4F6VPuo36V5wNF8Kk7OQF90sv8kvfGD0lfnJqjcCnFn5Do Aug 24 03:24:13.850248 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Domain-Id: None Aug 24 03:24:13.850248 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Domain-Name: None Aug 24 03:24:13.850248 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Identity-Status: Confirmed Aug 24 03:24:13.850248 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Is-Admin-Project: True Aug 24 03:24:13.850248 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 03:24:13.850248 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Project-Domain-Id: default Aug 24 03:24:13.850248 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Project-Domain-Name: Default Aug 24 03:24:13.850248 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Project-Id: 35c28eab9a294b9ba17b7f5b9c24d868 Aug 24 03:24:13.850248 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Project-Name: admin Aug 24 03:24:13.850248 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Role: reader,member,admin Aug 24 03:24:13.850248 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Roles: reader,member,admin Aug 24 03:24:13.851786 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/35c28eab9a294b9ba17b7f5b9c24d868"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_35c28eab9a294b9ba17b7f5b9c24d868", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/35c28eab9a294b9ba17b7f5b9c24d868"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/35c28eab9a294b9ba17b7f5b9c24d868"}]}] Aug 24 03:24:13.851786 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Tenant: admin Aug 24 03:24:13.851786 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Tenant-Id: 35c28eab9a294b9ba17b7f5b9c24d868 Aug 24 03:24:13.851786 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Tenant-Name: admin Aug 24 03:24:13.851786 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-User: admin Aug 24 03:24:13.851786 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-User-Domain-Id: default Aug 24 03:24:13.851786 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-User-Domain-Name: Default Aug 24 03:24:13.851786 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-User-Id: 5a8025e93c084f56aeda2462957536b8 Aug 24 03:24:13.851786 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-User-Name: admin Aug 24 03:24:13.851786 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: method: > Aug 24 03:24:13.851786 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: exception: Flavor 84 could not be found. Aug 24 03:24:13.851786 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: action_args: {'id': '84'} Aug 24 03:24:13.851786 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:24:13.851786 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:24:13.852629 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 03:24:13.852629 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 03:24:13.852629 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:24:13.852629 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:24:13.852629 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:24:13.852629 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:24:13.852629 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:24:13.852629 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:24:13.852629 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:24:13.852629 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:24:13.852629 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:24:13.852629 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:24:13.852629 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 03:24:13.852629 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi Aug 24 03:24:13.852629 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:24:13.852629 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi Aug 24 03:24:13.852629 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:24:13.852629 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:24:13.852629 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:24:13.853695 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:24:13.853695 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:24:13.853695 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:24:13.853695 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:24:13.853695 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 03:24:13.853695 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:24:13.853695 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 03:24:13.853695 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi Aug 24 03:24:13.853695 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:24:13.853695 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi Aug 24 03:24:13.853695 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:24:13.853695 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:24:13.853695 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:24:13.853695 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:24:13.853695 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:24:13.853695 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 03:24:13.853695 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi Aug 24 03:24:13.853695 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-5f86876b-37f1-4ba7-b334-cc2e868bb9ee admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:24:13.854694 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-5f86876b-37f1-4ba7-b334-cc2e868bb9ee admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012543 Aug 24 03:24:13.854694 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 23/47] 10.222.0.81 () {60 vars in 1190 bytes} [Wed Aug 24 03:24:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 03:24:14.874446 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-521ae6b3-b3a9-49a5-b1c8-e81d65de1d0d admin admin] Calling method '>' {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:14.875436 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-521ae6b3-b3a9-49a5-b1c8-e81d65de1d0d admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Aug 24 03:24:14.875848 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 25/48] 10.222.0.81 () {56 vars in 1074 bytes} [Wed Aug 24 03:24:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:24:15.413264 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-c95b03c8-c140-48b4-ad3a-f0574bfcc48c admin admin] Calling method '>' {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:15.418971 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.wsgi [None req-c95b03c8-c140-48b4-ad3a-f0574bfcc48c admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 03:24:15.420466 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-c95b03c8-c140-48b4-ad3a-f0574bfcc48c admin admin] Request method failure captured: Aug 24 03:24:15.420466 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 03:24:15.420466 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: Accept: application/json Aug 24 03:24:15.420466 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: Accept-Encoding: gzip, deflate Aug 24 03:24:15.420466 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: Connection: keep-alive Aug 24 03:24:15.420466 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: Content-Length: 0 Aug 24 03:24:15.420466 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: Host: 10.222.0.81 Aug 24 03:24:15.420466 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: Openstack-Api-Version: compute 2.90 Aug 24 03:24:15.420466 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: Openstack-System-Scope: None Aug 24 03:24:15.420466 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: User-Agent: python-novaclient Aug 24 03:24:15.420466 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Auth-Token: gAAAAABjBZnePtmvHdrn_jQYNlB656mqKh8yNAILLf40xsz7lNoW0SaXAtLAjqSNfO57Z9NiXmuon63vlFzD5qJw4q8lM89sryQN6HgMWb7ypDc6pkkMefoJBTFtrttmB0jL83KHZgbf08ZNRyt6b5DvZ6DI025IvtgDBZPGFN52hJtcM2u-Jbk Aug 24 03:24:15.420466 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Domain-Id: None Aug 24 03:24:15.420466 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Domain-Name: None Aug 24 03:24:15.420466 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Identity-Status: Confirmed Aug 24 03:24:15.420466 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Is-Admin-Project: True Aug 24 03:24:15.420466 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 03:24:15.420466 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Project-Domain-Id: default Aug 24 03:24:15.420466 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Project-Domain-Name: Default Aug 24 03:24:15.420466 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Project-Id: 35c28eab9a294b9ba17b7f5b9c24d868 Aug 24 03:24:15.420466 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Project-Name: admin Aug 24 03:24:15.420466 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Role: reader,member,admin Aug 24 03:24:15.420466 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Roles: reader,member,admin Aug 24 03:24:15.422083 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/35c28eab9a294b9ba17b7f5b9c24d868"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_35c28eab9a294b9ba17b7f5b9c24d868", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/35c28eab9a294b9ba17b7f5b9c24d868"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/35c28eab9a294b9ba17b7f5b9c24d868"}]}] Aug 24 03:24:15.422083 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Tenant: admin Aug 24 03:24:15.422083 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Tenant-Id: 35c28eab9a294b9ba17b7f5b9c24d868 Aug 24 03:24:15.422083 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-Tenant-Name: admin Aug 24 03:24:15.422083 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-User: admin Aug 24 03:24:15.422083 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-User-Domain-Id: default Aug 24 03:24:15.422083 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-User-Domain-Name: Default Aug 24 03:24:15.422083 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-User-Id: 5a8025e93c084f56aeda2462957536b8 Aug 24 03:24:15.422083 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: X-User-Name: admin Aug 24 03:24:15.422083 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: method: > Aug 24 03:24:15.422083 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: exception: Flavor 451 could not be found. Aug 24 03:24:15.422083 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: action_args: {'id': '451'} Aug 24 03:24:15.422083 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:24:15.422083 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:24:15.423149 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 03:24:15.423149 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 03:24:15.423149 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:24:15.423149 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:24:15.423149 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:24:15.423149 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:24:15.423149 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:24:15.423149 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:24:15.423149 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:24:15.423149 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:24:15.423149 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:24:15.423149 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:24:15.423149 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 03:24:15.423149 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi Aug 24 03:24:15.423149 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:24:15.423149 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi Aug 24 03:24:15.423149 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:24:15.423149 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:24:15.423149 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:24:15.424551 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:24:15.424551 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:24:15.424551 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:24:15.424551 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:24:15.424551 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 03:24:15.424551 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:24:15.424551 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 03:24:15.424551 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi Aug 24 03:24:15.424551 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:24:15.424551 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi Aug 24 03:24:15.424551 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:24:15.424551 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:24:15.424551 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:24:15.424551 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:24:15.424551 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:24:15.424551 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 03:24:15.424551 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: ERROR nova.api.openstack.wsgi Aug 24 03:24:15.424551 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-c95b03c8-c140-48b4-ad3a-f0574bfcc48c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:24:15.425939 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-c95b03c8-c140-48b4-ad3a-f0574bfcc48c admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.409437 Aug 24 03:24:15.425939 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 24/49] 10.222.0.81 () {60 vars in 1193 bytes} [Wed Aug 24 03:24:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 410 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:24:15.432473 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-14469a9e-4929-48dd-9ec1-e9cde952a5ca admin admin] Calling method '>' {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:15.449365 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-14469a9e-4929-48dd-9ec1-e9cde952a5ca admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020630 Aug 24 03:24:15.449887 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 26/50] 10.222.0.81 () {60 vars in 1210 bytes} [Wed Aug 24 03:24:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:24:15.459699 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-b5cfc72e-311b-46e1-8cb7-72f474e2ab42 admin admin] Calling method '>' {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:15.475191 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-b5cfc72e-311b-46e1-8cb7-72f474e2ab42 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019543 Aug 24 03:24:15.475755 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 25/51] 10.222.0.81 () {60 vars in 1210 bytes} [Wed Aug 24 03:24:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:24:15.484921 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-7fcc7ab1-2938-47dc-96af-188fca41b8f9 admin admin] Calling method '>' {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:15.491079 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.wsgi [None req-7fcc7ab1-2938-47dc-96af-188fca41b8f9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 03:24:15.492562 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-7fcc7ab1-2938-47dc-96af-188fca41b8f9 admin admin] Request method failure captured: Aug 24 03:24:15.492562 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 03:24:15.492562 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: Accept: application/json Aug 24 03:24:15.492562 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: Accept-Encoding: gzip, deflate Aug 24 03:24:15.492562 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: Connection: keep-alive Aug 24 03:24:15.492562 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: Content-Length: 0 Aug 24 03:24:15.492562 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: Host: 10.222.0.81 Aug 24 03:24:15.492562 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: Openstack-Api-Version: compute 2.90 Aug 24 03:24:15.492562 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: Openstack-System-Scope: None Aug 24 03:24:15.492562 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: User-Agent: python-novaclient Aug 24 03:24:15.492562 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Auth-Token: gAAAAABjBZnePtmvHdrn_jQYNlB656mqKh8yNAILLf40xsz7lNoW0SaXAtLAjqSNfO57Z9NiXmuon63vlFzD5qJw4q8lM89sryQN6HgMWb7ypDc6pkkMefoJBTFtrttmB0jL83KHZgbf08ZNRyt6b5DvZ6DI025IvtgDBZPGFN52hJtcM2u-Jbk Aug 24 03:24:15.492562 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Domain-Id: None Aug 24 03:24:15.492562 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Domain-Name: None Aug 24 03:24:15.492562 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Identity-Status: Confirmed Aug 24 03:24:15.492562 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Is-Admin-Project: True Aug 24 03:24:15.492562 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 03:24:15.492562 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Project-Domain-Id: default Aug 24 03:24:15.492562 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Project-Domain-Name: Default Aug 24 03:24:15.492562 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Project-Id: 35c28eab9a294b9ba17b7f5b9c24d868 Aug 24 03:24:15.492562 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Project-Name: admin Aug 24 03:24:15.492562 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Role: reader,member,admin Aug 24 03:24:15.492562 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Roles: reader,member,admin Aug 24 03:24:15.494287 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/35c28eab9a294b9ba17b7f5b9c24d868"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_35c28eab9a294b9ba17b7f5b9c24d868", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/35c28eab9a294b9ba17b7f5b9c24d868"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/35c28eab9a294b9ba17b7f5b9c24d868"}]}] Aug 24 03:24:15.494287 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Tenant: admin Aug 24 03:24:15.494287 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Tenant-Id: 35c28eab9a294b9ba17b7f5b9c24d868 Aug 24 03:24:15.494287 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-Tenant-Name: admin Aug 24 03:24:15.494287 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-User: admin Aug 24 03:24:15.494287 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-User-Domain-Id: default Aug 24 03:24:15.494287 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-User-Domain-Name: Default Aug 24 03:24:15.494287 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-User-Id: 5a8025e93c084f56aeda2462957536b8 Aug 24 03:24:15.494287 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: X-User-Name: admin Aug 24 03:24:15.494287 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: method: > Aug 24 03:24:15.494287 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: exception: Flavor 451 could not be found. Aug 24 03:24:15.494287 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: action_args: {'id': '451'} Aug 24 03:24:15.494287 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:24:15.494287 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:24:15.495376 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 03:24:15.495376 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 03:24:15.495376 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:24:15.495376 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:24:15.495376 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:24:15.495376 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:24:15.495376 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:24:15.495376 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:24:15.495376 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:24:15.495376 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:24:15.495376 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:24:15.495376 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:24:15.495376 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 03:24:15.495376 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi Aug 24 03:24:15.495376 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:24:15.495376 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi Aug 24 03:24:15.495376 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:24:15.495376 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:24:15.495376 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:24:15.496683 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:24:15.496683 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:24:15.496683 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:24:15.496683 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:24:15.496683 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 03:24:15.496683 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:24:15.496683 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 03:24:15.496683 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi Aug 24 03:24:15.496683 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:24:15.496683 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi Aug 24 03:24:15.496683 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:24:15.496683 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:24:15.496683 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:24:15.496683 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:24:15.496683 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:24:15.496683 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 03:24:15.496683 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: ERROR nova.api.openstack.wsgi Aug 24 03:24:15.496683 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-7fcc7ab1-2938-47dc-96af-188fca41b8f9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:24:15.498063 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-7fcc7ab1-2938-47dc-96af-188fca41b8f9 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012541 Aug 24 03:24:15.498063 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 27/52] 10.222.0.81 () {60 vars in 1193 bytes} [Wed Aug 24 03:24:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:24:16.470250 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-b5cfc72e-311b-46e1-8cb7-72f474e2ab42 admin admin] Calling method '>' {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:16.471285 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-b5cfc72e-311b-46e1-8cb7-72f474e2ab42 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 24 03:24:16.471723 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 26/53] 10.222.0.81 () {56 vars in 1074 bytes} [Wed Aug 24 03:24:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:24:17.029876 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-abac6b5e-f799-4575-83db-e9a46b49cd49 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:24:17.049650 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-abac6b5e-f799-4575-83db-e9a46b49cd49 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.439678 Aug 24 03:24:17.050193 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 28/54] 10.222.0.81 () {64 vars in 1235 bytes} [Wed Aug 24 03:24:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:24:18.011795 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-b5cfc72e-311b-46e1-8cb7-72f474e2ab42 admin admin] Calling method '>' {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:18.012865 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-b5cfc72e-311b-46e1-8cb7-72f474e2ab42 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 24 03:24:18.013263 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 27/55] 10.222.0.81 () {56 vars in 1074 bytes} [Wed Aug 24 03:24:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:24:18.559237 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-a428af7f-78fc-4c1e-b62f-ca7bf4f7b074 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:24:18.577482 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-a428af7f-78fc-4c1e-b62f-ca7bf4f7b074 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.420611 Aug 24 03:24:18.578013 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 29/56] 10.222.0.81 () {64 vars in 1235 bytes} [Wed Aug 24 03:24:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:24:19.546249 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-b5cfc72e-311b-46e1-8cb7-72f474e2ab42 admin admin] Calling method '>' {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:19.547264 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-b5cfc72e-311b-46e1-8cb7-72f474e2ab42 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 24 03:24:19.547660 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 28/57] 10.222.0.81 () {56 vars in 1074 bytes} [Wed Aug 24 03:24:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:24:20.083399 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-13040afa-2fb3-45b5-a1a6-7e964ec79abb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:24:20.104898 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-13040afa-2fb3-45b5-a1a6-7e964ec79abb admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.414926 Aug 24 03:24:20.105441 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 30/58] 10.222.0.81 () {64 vars in 1235 bytes} [Wed Aug 24 03:24:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:24:21.083232 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-b5cfc72e-311b-46e1-8cb7-72f474e2ab42 admin admin] Calling method '>' {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:21.084254 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-b5cfc72e-311b-46e1-8cb7-72f474e2ab42 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Aug 24 03:24:21.084687 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 29/59] 10.222.0.81 () {56 vars in 1074 bytes} [Wed Aug 24 03:24:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:24:21.632246 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-e8b3c28d-ddf4-415a-a268-24f95d9edfa3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:24:21.651251 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-e8b3c28d-ddf4-415a-a268-24f95d9edfa3 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.409371 Aug 24 03:24:21.651861 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 31/60] 10.222.0.81 () {64 vars in 1235 bytes} [Wed Aug 24 03:24:21 2022] POST /compute/v2.1/flavors => generated 409 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:24:22.628879 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-b5cfc72e-311b-46e1-8cb7-72f474e2ab42 admin admin] Calling method '>' {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:22.630256 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-b5cfc72e-311b-46e1-8cb7-72f474e2ab42 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001876 Aug 24 03:24:22.630661 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 30/61] 10.222.0.81 () {56 vars in 1074 bytes} [Wed Aug 24 03:24:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:24:23.152479 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-fe085561-b8d2-4ef6-8a07-9b88de5f2dc6 admin admin] Calling method '>' {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:23.173264 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-fe085561-b8d2-4ef6-8a07-9b88de5f2dc6 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.405857 Aug 24 03:24:23.173734 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 32/62] 10.222.0.81 () {60 vars in 1202 bytes} [Wed Aug 24 03:24:22 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:25:17.427878 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-b5cfc72e-311b-46e1-8cb7-72f474e2ab42 admin admin] Calling method '>' {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:17.428950 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-b5cfc72e-311b-46e1-8cb7-72f474e2ab42 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 24 03:25:17.429399 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 31/63] 10.222.0.81 () {54 vars in 931 bytes} [Wed Aug 24 03:25:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:25:17.442063 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG dbcounter [-] [105517] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:17.843706 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-bf508b8d-d118-4ddf-a51e-ceb6c6fb5846 admin admin] Calling method '>' {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:17.865066 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-bf508b8d-d118-4ddf-a51e-ceb6c6fb5846 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.429589 Aug 24 03:25:17.865604 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 33/64] 10.222.0.81 () {60 vars in 1292 bytes} [Wed Aug 24 03:25:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:25:17.886910 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG dbcounter [-] [105518] Writing DB stats nova_api:SELECT=14 {{(pid=105518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:17.891139 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-a011b00b-7acd-4dd8-b194-0c77c935bf94 admin admin] Calling method '>' {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:17.899153 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-a011b00b-7acd-4dd8-b194-0c77c935bf94 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013618 Aug 24 03:25:17.899689 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 32/65] 10.222.0.81 () {60 vars in 1283 bytes} [Wed Aug 24 03:25:17 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:25:17.911511 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-a78b9884-e802-4945-b109-7c5d7d408ab8 admin admin] Calling method '>' {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:17.919209 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-a78b9884-e802-4945-b109-7c5d7d408ab8 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011294 Aug 24 03:25:17.919730 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 34/66] 10.222.0.81 () {60 vars in 1286 bytes} [Wed Aug 24 03:25:17 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:25:17.931851 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-53328166-9c61-473e-9c0a-947e08bd49a0 admin admin] Calling method '>' {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:17.940198 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-53328166-9c61-473e-9c0a-947e08bd49a0 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011924 Aug 24 03:25:17.940706 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 33/67] 10.222.0.81 () {60 vars in 1286 bytes} [Wed Aug 24 03:25:17 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:25:17.951921 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-fde1ab2d-f6fa-4d2c-829b-8226555a8a66 admin admin] Calling method '>' {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:25:17.959541 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-fde1ab2d-f6fa-4d2c-829b-8226555a8a66 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011091 Aug 24 03:25:17.960049 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 35/68] 10.222.0.81 () {60 vars in 1283 bytes} [Wed Aug 24 03:25:17 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:28:11.603209 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-53328166-9c61-473e-9c0a-947e08bd49a0 admin admin] Calling method '>' {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:28:11.604218 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-53328166-9c61-473e-9c0a-947e08bd49a0 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 24 03:28:11.604669 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 34/69] 10.222.0.81 () {56 vars in 1074 bytes} [Wed Aug 24 03:28:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:28:11.747033 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG dbcounter [-] [105517] Writing DB stats nova_api:SELECT=6 {{(pid=105517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:11.905785 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-951488b8-5607-4748-8e1b-a0931d093536 admin admin] Calling method '>' {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:28:11.908094 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:28:11.908094 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: warnings.warn(msg) Aug 24 03:28:11.909246 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG oslo_concurrency.lockutils [None req-951488b8-5607-4748-8e1b-a0931d093536 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:11.909756 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG oslo_concurrency.lockutils [None req-951488b8-5607-4748-8e1b-a0931d093536 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:11.910444 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG oslo_concurrency.lockutils [None req-951488b8-5607-4748-8e1b-a0931d093536 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:11.910865 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG oslo_concurrency.lockutils [None req-951488b8-5607-4748-8e1b-a0931d093536 admin admin] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:11.911301 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG oslo_concurrency.lockutils [None req-951488b8-5607-4748-8e1b-a0931d093536 admin admin] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:11.911708 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG oslo_concurrency.lockutils [None req-951488b8-5607-4748-8e1b-a0931d093536 admin admin] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:11.945325 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-951488b8-5607-4748-8e1b-a0931d093536 admin admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.200263 Aug 24 03:28:11.945881 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 36/70] 10.222.0.81 () {60 vars in 1193 bytes} [Wed Aug 24 03:28:11 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:28:12.771797 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-53328166-9c61-473e-9c0a-947e08bd49a0 admin admin] Calling method '>' {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:28:12.772843 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-53328166-9c61-473e-9c0a-947e08bd49a0 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 24 03:28:12.773245 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 35/71] 10.222.0.81 () {56 vars in 1074 bytes} [Wed Aug 24 03:28:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:28:12.963665 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-2afd45f0-72ce-4295-abe2-52a8e86c208d admin admin] Calling method '>' {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:28:12.966569 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:28:12.966569 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: warnings.warn(msg) Aug 24 03:28:12.967675 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG oslo_concurrency.lockutils [None req-2afd45f0-72ce-4295-abe2-52a8e86c208d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:12.968154 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG oslo_concurrency.lockutils [None req-2afd45f0-72ce-4295-abe2-52a8e86c208d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:12.968586 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG oslo_concurrency.lockutils [None req-2afd45f0-72ce-4295-abe2-52a8e86c208d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:12.969335 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG oslo_concurrency.lockutils [None req-2afd45f0-72ce-4295-abe2-52a8e86c208d admin admin] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:12.969785 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG oslo_concurrency.lockutils [None req-2afd45f0-72ce-4295-abe2-52a8e86c208d admin admin] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:12.970203 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG oslo_concurrency.lockutils [None req-2afd45f0-72ce-4295-abe2-52a8e86c208d admin admin] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:12.990737 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-2afd45f0-72ce-4295-abe2-52a8e86c208d admin admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078686 Aug 24 03:28:12.991230 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 37/72] 10.222.0.81 () {60 vars in 1193 bytes} [Wed Aug 24 03:28:12 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:28:24.220676 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-53328166-9c61-473e-9c0a-947e08bd49a0 admin admin] Calling method '>' {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:28:24.221752 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-53328166-9c61-473e-9c0a-947e08bd49a0 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Aug 24 03:28:24.222620 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 36/73] 10.222.0.81 () {56 vars in 1074 bytes} [Wed Aug 24 03:28:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:28:24.402974 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG dbcounter [-] [105517] Writing DB stats nova_cell0:SELECT=4 {{(pid=105517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:24.403699 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG dbcounter [-] [105517] Writing DB stats nova_cell1:SELECT=4 {{(pid=105517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:24.404924 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG dbcounter [-] [105517] Writing DB stats nova_api:SELECT=8 {{(pid=105517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:24.453851 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-5cc511b6-365d-462f-8450-7382c7724d0f admin admin] Calling method '>' {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:28:24.456261 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:28:24.456261 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: warnings.warn(msg) Aug 24 03:28:24.457505 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG oslo_concurrency.lockutils [None req-5cc511b6-365d-462f-8450-7382c7724d0f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:24.457977 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG oslo_concurrency.lockutils [None req-5cc511b6-365d-462f-8450-7382c7724d0f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:24.458399 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG oslo_concurrency.lockutils [None req-5cc511b6-365d-462f-8450-7382c7724d0f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:24.459104 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG oslo_concurrency.lockutils [None req-5cc511b6-365d-462f-8450-7382c7724d0f admin admin] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:24.459542 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG oslo_concurrency.lockutils [None req-5cc511b6-365d-462f-8450-7382c7724d0f admin admin] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:24.459954 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG oslo_concurrency.lockutils [None req-5cc511b6-365d-462f-8450-7382c7724d0f admin admin] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:24.485423 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-5cc511b6-365d-462f-8450-7382c7724d0f admin admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.086789 Aug 24 03:28:24.485984 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 38/74] 10.222.0.81 () {60 vars in 1193 bytes} [Wed Aug 24 03:28:24 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:28:25.321349 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: DEBUG nova.api.openstack.wsgi [None req-53328166-9c61-473e-9c0a-947e08bd49a0 admin admin] Calling method '>' {{(pid=105518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:28:25.322352 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: INFO nova.api.openstack.requestlog [None req-53328166-9c61-473e-9c0a-947e08bd49a0 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 24 03:28:25.322752 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: [pid: 105518|app: 0|req: 37/75] 10.222.0.81 () {56 vars in 1074 bytes} [Wed Aug 24 03:28:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:28:25.513421 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG nova.api.openstack.wsgi [None req-f639af55-25dd-46f0-8799-9cd0e2458a99 admin admin] Calling method '>' {{(pid=105517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:28:25.516799 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:28:25.516799 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: warnings.warn(msg) Aug 24 03:28:25.517918 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG oslo_concurrency.lockutils [None req-f639af55-25dd-46f0-8799-9cd0e2458a99 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:25.518393 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG oslo_concurrency.lockutils [None req-f639af55-25dd-46f0-8799-9cd0e2458a99 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:25.518820 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG oslo_concurrency.lockutils [None req-f639af55-25dd-46f0-8799-9cd0e2458a99 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:25.519525 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG oslo_concurrency.lockutils [None req-f639af55-25dd-46f0-8799-9cd0e2458a99 admin admin] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:25.519969 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG oslo_concurrency.lockutils [None req-f639af55-25dd-46f0-8799-9cd0e2458a99 admin admin] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:25.520384 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: DEBUG oslo_concurrency.lockutils [None req-f639af55-25dd-46f0-8799-9cd0e2458a99 admin admin] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:25.542204 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: INFO nova.api.openstack.requestlog [None req-f639af55-25dd-46f0-8799-9cd0e2458a99 admin admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079917 Aug 24 03:28:25.542680 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: [pid: 105517|app: 0|req: 39/76] 10.222.0.81 () {60 vars in 1193 bytes} [Wed Aug 24 03:28:25 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:29:23.623158 dv-cinder-854261-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 03:29:23.623711 dv-cinder-854261-1-iscsi devstack@n-api.service[105516]: Wed Aug 24 03:29:23 2022 - graceful shutdown triggered... Aug 24 03:29:23.624146 dv-cinder-854261-1-iscsi devstack@n-api.service[105518]: Gracefully killing worker 2 (pid: 105518)... Aug 24 03:29:23.624511 dv-cinder-854261-1-iscsi devstack@n-api.service[105517]: Gracefully killing worker 1 (pid: 105517)... Aug 24 03:29:24.624851 dv-cinder-854261-1-iscsi devstack@n-api.service[105516]: worker 1 buried after 1 seconds Aug 24 03:29:24.625352 dv-cinder-854261-1-iscsi devstack@n-api.service[105516]: worker 2 buried after 1 seconds Aug 24 03:29:24.625352 dv-cinder-854261-1-iscsi devstack@n-api.service[105516]: goodbye to uWSGI. Aug 24 03:29:24.626479 dv-cinder-854261-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 03:29:24.627033 dv-cinder-854261-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 03:29:24.629875 dv-cinder-854261-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 03:29:24.640677 dv-cinder-854261-1-iscsi devstack@n-api.service[120690]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 03:29:24.643352 dv-cinder-854261-1-iscsi devstack@n-api.service[120690]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 03:29:24 2022] *** Aug 24 03:29:24.643352 dv-cinder-854261-1-iscsi devstack@n-api.service[120690]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 03:29:24.643352 dv-cinder-854261-1-iscsi devstack@n-api.service[120690]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 03:29:24.643352 dv-cinder-854261-1-iscsi devstack@n-api.service[120690]: nodename: dv-cinder-854261-1-iscsi Aug 24 03:29:24.643352 dv-cinder-854261-1-iscsi devstack@n-api.service[120690]: machine: x86_64 Aug 24 03:29:24.643352 dv-cinder-854261-1-iscsi devstack@n-api.service[120690]: clock source: unix Aug 24 03:29:24.643352 dv-cinder-854261-1-iscsi devstack@n-api.service[120690]: pcre jit disabled Aug 24 03:29:24.643352 dv-cinder-854261-1-iscsi devstack@n-api.service[120690]: detected number of CPU cores: 4 Aug 24 03:29:24.643352 dv-cinder-854261-1-iscsi devstack@n-api.service[120690]: current working directory: / Aug 24 03:29:24.643352 dv-cinder-854261-1-iscsi devstack@n-api.service[120690]: detected binary path: /usr/bin/uwsgi-core Aug 24 03:29:24.643352 dv-cinder-854261-1-iscsi devstack@n-api.service[120690]: your processes number limit is 47680 Aug 24 03:29:24.643352 dv-cinder-854261-1-iscsi devstack@n-api.service[120690]: your memory page size is 4096 bytes Aug 24 03:29:24.643352 dv-cinder-854261-1-iscsi devstack@n-api.service[120690]: detected max file descriptor number: 2048 Aug 24 03:29:24.643352 dv-cinder-854261-1-iscsi devstack@n-api.service[120690]: lock engine: pthread robust mutexes Aug 24 03:29:24.644725 dv-cinder-854261-1-iscsi devstack@n-api.service[120690]: thunder lock: enabled Aug 24 03:29:24.644725 dv-cinder-854261-1-iscsi devstack@n-api.service[120690]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 03:29:24.644725 dv-cinder-854261-1-iscsi devstack@n-api.service[120690]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 03:29:24.685389 dv-cinder-854261-1-iscsi devstack@n-api.service[120690]: Python main interpreter initialized at 0x55f106ce39c0 Aug 24 03:29:24.685389 dv-cinder-854261-1-iscsi devstack@n-api.service[120690]: python threads support enabled Aug 24 03:29:24.685389 dv-cinder-854261-1-iscsi devstack@n-api.service[120690]: your server socket listen backlog is limited to 100 connections Aug 24 03:29:24.685389 dv-cinder-854261-1-iscsi devstack@n-api.service[120690]: your mercy for graceful operations on workers is 90 seconds Aug 24 03:29:24.685811 dv-cinder-854261-1-iscsi devstack@n-api.service[120690]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 03:29:24.685887 dv-cinder-854261-1-iscsi devstack@n-api.service[120690]: *** Operational MODE: preforking *** Aug 24 03:29:24.686179 dv-cinder-854261-1-iscsi devstack@n-api.service[120690]: *** uWSGI is running in multiple interpreter mode *** Aug 24 03:29:24.686179 dv-cinder-854261-1-iscsi devstack@n-api.service[120690]: spawned uWSGI master process (pid: 120690) Aug 24 03:29:24.686377 dv-cinder-854261-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 03:29:24.689350 dv-cinder-854261-1-iscsi devstack@n-api.service[120690]: spawned uWSGI worker 1 (pid: 120708, cores: 1) Aug 24 03:29:24.689350 dv-cinder-854261-1-iscsi devstack@n-api.service[120690]: spawned uWSGI worker 2 (pid: 120709, cores: 1) Aug 24 03:29:24.689350 dv-cinder-854261-1-iscsi devstack@n-api.service[120690]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 03:29:25.353588 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 03:29:25.357668 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 03:29:26.518485 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:29:26.518485 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: from cryptography.utils import int_from_bytes Aug 24 03:29:26.519120 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:29:26.519120 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: from cryptography.utils import int_from_bytes Aug 24 03:29:26.521160 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:29:26.521160 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: from cryptography.utils import int_from_bytes Aug 24 03:29:26.521622 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:29:26.521622 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: from cryptography.utils import int_from_bytes Aug 24 03:29:28.961498 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 03:29:28.962075 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 03:29:28.962283 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 03:29:28.962655 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 03:29:28.962915 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 03:29:28.963302 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.963632 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.963755 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 03:29:28.964139 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.964253 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 03:29:28.964338 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.964556 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 03:29:28.964830 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.964947 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 03:29:28.965073 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.965182 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 03:29:28.965399 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.965558 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.965729 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.965891 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.966063 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.966221 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.966310 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.966548 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.966651 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.966946 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854261-1-iscsi {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.967035 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.967272 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.967377 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.967583 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.967682 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.967896 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.967994 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.968214 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.968319 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.968519 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.968620 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.968867 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.968962 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.969188 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.969293 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854261-1-iscsi {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.969517 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.969689 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.969831 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.970148 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.970272 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.970458 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.970554 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.970766 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.970865 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.971095 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.971216 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.971408 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.971510 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.971835 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.971962 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.972154 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.972267 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.972346 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.972569 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.972680 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.977110 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.977228 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.977318 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.977401 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854261-1-iscsi {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.977481 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.977562 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.977649 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.977730 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.977808 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.977886 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.977963 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.978039 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.978127 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.978205 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.978282 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.978352 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.978420 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854261-1-iscsi {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.978500 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.978572 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.978653 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.978731 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.978810 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.978893 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.978975 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.979056 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.979133 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.979209 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.979286 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.979365 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.979442 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.979513 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.979590 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.979660 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.979750 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.979832 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.979910 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.979991 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.980062 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.980141 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.980217 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.980298 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.980375 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.980375 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.980506 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.980581 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.980651 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.980847 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.981906 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.982005 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.982096 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.982197 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.982296 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.982390 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.982486 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.982582 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.982680 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.982766 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.982858 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.982944 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.983053 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.983161 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.983268 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.983415 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.983717 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.983717 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.983889 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.984032 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.984155 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.984332 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.984438 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.984585 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.984677 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.984937 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.985044 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.985257 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.985345 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.985573 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.985669 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.985889 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.985992 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.986199 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.986326 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.986512 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.986602 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.986826 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.986928 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.81 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.987140 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.987233 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.81 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.987451 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.987541 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.987763 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.987864 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.988088 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.988185 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.988400 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.988487 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.988723 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.988876 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.989143 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.989631 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.989631 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.989870 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.990008 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.990133 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.81 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.990133 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.81 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.990287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.990375 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.990457 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.990694 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.990792 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.991015 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.991109 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.991268 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.991539 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.991644 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.991872 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.991974 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.992190 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.992278 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.992500 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.992866 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.993092 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.993197 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.993402 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.993492 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.993707 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.993806 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.994021 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.994129 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.994327 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.994416 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.994599 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.994688 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.994907 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.994997 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.995222 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.995317 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.995525 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.995621 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.995835 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.995924 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.996141 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.996230 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.996447 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.996545 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.996752 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.996904 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.997169 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.997283 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.997477 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.997564 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.997786 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.997875 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.998109 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.998210 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.998403 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.998502 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.998709 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.998808 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.999018 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.999105 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.999326 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.999425 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.999635 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.999730 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:28.999942 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.000037 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.000246 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.000335 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.000564 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.000654 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.000894 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.001003 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.001271 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.001425 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.001522 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.001613 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.001824 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.001940 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.002136 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.002237 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.002451 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.002541 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.002760 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.002859 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.003065 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.003164 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.003368 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.003459 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.003671 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.003776 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.003975 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.004087 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.004281 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.004389 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.005157 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.005272 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.005470 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.005579 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.005814 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.005926 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.006096 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.006195 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.006421 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.006523 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.006734 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.006836 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.007045 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.007135 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.007353 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.007443 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.007659 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.007756 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.008000 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.008112 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.008301 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.008392 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.008618 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.008707 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.008953 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.009051 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.009278 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.009362 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.009609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.009796 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.009940 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.010028 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.010259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.010339 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.010570 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.010658 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.010896 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:29:29.010974 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.011235 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.011330 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.011558 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.011650 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.011873 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.011962 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.012211 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.012305 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.012549 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.012640 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.014622 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.014798 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.014959 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.015083 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.015171 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.015253 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.015334 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.015516 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.015598 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.015750 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.015858 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.016001 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.016089 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.016171 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.016253 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.016429 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.016528 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.016628 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.016719 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.016837 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.016930 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.017125 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.017240 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.017378 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.017465 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.017554 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.017642 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.017731 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.017731 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.017892 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.017981 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.018073 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.018155 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.018244 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.018342 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.018431 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.018581 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.018673 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.018900 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.018998 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.019224 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.019320 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.019543 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.019633 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.019861 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.019964 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.020234 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.021457 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.021571 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.021669 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.021923 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.022030 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.022729 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.022817 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.022899 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.023156 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.023259 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.023357 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.023441 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.023523 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.023604 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.023685 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.023783 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.023874 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.023965 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.024055 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.024146 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.024237 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.024363 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.024493 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.024731 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.024864 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.025066 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.025215 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.025374 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.025549 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.025636 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.025875 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.025965 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.026197 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.026295 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.026528 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.026977 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.027075 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.027166 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.027263 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.027354 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.027470 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.027601 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.027780 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.027870 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.028148 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.028259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.028399 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.028517 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.028717 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.028852 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.029055 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.029148 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.029368 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.029490 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.029738 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.029830 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.029997 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.030090 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.030309 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.030412 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.030635 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.030736 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.030945 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.031060 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.031255 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.031352 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.031572 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.031677 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.031892 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.031979 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.032209 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.032307 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.032524 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.032621 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.032860 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.032967 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.033193 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.033354 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.033490 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.033650 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.033798 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.033933 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.034132 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.034273 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.034447 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.034581 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.034776 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.034911 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.035080 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.035178 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.035399 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.035544 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.035720 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.035898 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.036179 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.036276 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.036507 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.036692 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.036873 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.037019 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.037199 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.037334 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.037523 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.037667 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.037838 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.037989 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.038149 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.038290 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.038461 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.038595 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.038771 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.038914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.039081 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.039228 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.039372 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.039516 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.039706 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.039839 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.040021 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.040169 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.040315 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.040457 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.040626 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.040817 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.040964 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.041110 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.041249 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.041391 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.041560 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.041694 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.041858 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.042003 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.042160 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.042302 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.042463 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.042596 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.042775 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.042929 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.043106 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.043260 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.043423 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.043562 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.043734 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.043878 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.044051 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.044192 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.044362 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.044496 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.044691 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.044847 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.045039 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.045135 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.045355 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.045449 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.045682 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.045779 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.045995 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.046092 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.046324 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.046422 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.046642 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.046746 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.046976 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.047085 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.047279 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.047416 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.047599 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.047679 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.047928 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.048251 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.048580 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.048673 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.048933 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.049030 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.049264 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.049350 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.049581 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.049671 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.049913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.049992 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.050232 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.050317 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.050563 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.050642 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.050876 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.050954 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.052323 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.052432 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.052518 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.052616 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.052616 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.052833 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.053762 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.053866 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.053950 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.054023 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.054093 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.054162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.054231 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.054306 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.054407 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.054492 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.054582 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.054764 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.054852 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.054942 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.055037 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.055116 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.055186 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.055273 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.055356 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.055490 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.055590 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.055674 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.055762 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.055845 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.056049 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.056147 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.056365 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.056464 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.056691 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.056825 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.057031 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.057134 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.057354 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.057453 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.057689 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.057778 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.058004 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.058164 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.058323 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.058420 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.058639 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.058737 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.058955 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.059045 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.059264 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.059360 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.059582 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.059671 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.059893 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.059989 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.060201 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.060291 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.060510 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.060607 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.060846 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.060951 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.061170 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.061266 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.061484 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.061572 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.061800 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.061896 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.062113 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.062251 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.062423 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.062523 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.062733 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.062829 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.063041 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.063135 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.063352 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.063449 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.063662 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.063753 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.063972 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.064061 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.064279 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.064376 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.064615 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.064703 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.064950 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.065052 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.065259 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.065361 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.065582 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.065698 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.065903 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.066001 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.066216 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.066312 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.066525 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.066614 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.066836 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.066925 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.067724 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.067834 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.068042 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.068132 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.068359 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.068502 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.068672 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.068842 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.069022 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.069161 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.069349 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.069480 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.069667 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.069799 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.069989 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.070119 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.070305 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.070447 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.070621 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.070761 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.070949 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.071078 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.071272 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.071395 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.071590 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.071707 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.071911 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.072023 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.072232 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.072335 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.072558 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.072923 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.073018 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.073280 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.073417 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.073644 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.073768 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.073914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.074029 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.074234 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.074363 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.074561 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.074687 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.074872 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.074988 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.075198 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.075323 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.075543 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.075764 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.076032 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.076172 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.076293 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.076411 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.076527 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.076737 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.076894 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.077074 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.077200 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.077384 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.077507 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.077874 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.078214 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.078563 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.078881 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.079198 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.079512 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.079826 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.080144 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.080458 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.080797 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.081054 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.081179 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.081411 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.081527 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.081722 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.081847 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.082033 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.082161 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.082343 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.082468 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.082754 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.083556 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.083740 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.083940 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.084094 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.084219 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.084449 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.084565 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.084908 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.085065 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.085220 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.085361 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.085508 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.085657 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.085886 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.086037 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.086179 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.086318 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.086465 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.086616 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.086770 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.086916 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.087064 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.087210 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.087351 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.087640 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.087787 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.088054 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.088307 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.088495 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.088650 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.088927 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.089093 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.089266 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.089414 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.089578 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.089739 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.089881 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.090029 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.090193 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.090340 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.090486 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.090640 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.090812 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.090968 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.091125 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.091280 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.091420 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.091635 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.091786 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.091927 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.092067 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.092214 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.092367 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.092515 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.092656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.092894 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.093051 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.093260 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.093414 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.093555 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.093695 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.093867 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.094105 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.094251 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.094399 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.094547 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.094686 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.094825 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.094964 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.095102 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.095261 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.095408 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.095556 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.095704 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.095869 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.096092 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.096247 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.096388 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.096528 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.096667 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.096867 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.097033 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.097182 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.097340 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.097480 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.097625 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.097807 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.097971 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.098130 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.098547 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.098761 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.098918 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.099068 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.099334 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.099491 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.099666 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.099819 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.099982 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.100136 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.100313 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.100469 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.100638 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.100818 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.100964 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.101116 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.101280 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.101428 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.101576 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.101727 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.101890 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.102046 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.102195 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.102342 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.102505 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.102659 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.102801 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.102990 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.103153 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.103294 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.103442 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.103616 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.103774 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.103950 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.104115 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.104328 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.104473 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.104614 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.104789 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.104938 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.105078 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.105217 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.105356 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.105515 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.105670 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.105828 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.105970 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.106194 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.106340 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.106479 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.106628 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.106776 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.106916 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.107055 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.107202 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.107342 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.107489 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.107638 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.107778 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.107917 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.108078 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.108411 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.108603 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.108748 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.109021 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.109177 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.109325 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.109479 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.109643 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.109789 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.109963 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.110107 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.110256 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.110409 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.110585 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.110741 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.110907 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.111060 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.111208 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.111358 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.111539 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.111694 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.111870 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.112031 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.112185 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.112332 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.112480 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.112621 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.112830 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.112990 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.113152 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.113303 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.113443 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.113590 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.113762 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.114022 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.114221 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.114555 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.114713 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.114862 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.115036 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.115192 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.115376 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.115523 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.115701 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.115848 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.116026 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.116207 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.116424 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.116587 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.116736 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.116905 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.117063 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.117214 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.117355 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.117496 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.117888 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.118083 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.118232 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.118418 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.118692 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.118850 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.118996 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.119168 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.119317 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.119472 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.119637 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.119917 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.120073 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.120244 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.120401 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.120568 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.120722 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.120915 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.121076 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.121218 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.121394 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.121549 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.121728 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.121874 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.122051 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.122205 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.122372 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.122572 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.122809 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.122956 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.123162 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.123485 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.123644 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.123793 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.123945 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.124107 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.124497 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.124665 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.124844 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.125081 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.125238 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.125414 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.125568 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.125723 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.125873 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.126020 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.126160 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.126299 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.126463 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.126686 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.126838 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.126987 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.127127 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.127359 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.127505 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.127683 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.127841 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.127988 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.128126 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.128380 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.128547 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.128969 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.129118 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.129257 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.129408 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.130076 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.130298 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.130479 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.130626 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.130939 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.131106 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.131248 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.131465 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.131615 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.131793 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.131940 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.132118 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.132264 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.132438 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.132594 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.132781 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.132933 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.133118 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.133283 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.133425 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.133563 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.133738 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.133892 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.134119 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.134281 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.134453 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.134686 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.134842 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.134998 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.135158 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.135306 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.135501 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.135655 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.135821 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.135974 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.136139 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.136293 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.136441 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.136589 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.136865 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.137026 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.137177 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.137329 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.137476 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.137616 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.137755 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.137906 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.138048 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.138195 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.138336 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.138568 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.138724 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.139001 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.139197 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.139345 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.139507 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.139654 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.139804 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.139946 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.140135 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.140283 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.140447 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.140594 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.140791 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.140961 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.141102 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.141247 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.141435 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.141593 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.141770 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.141916 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.142088 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.142235 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.142421 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.142575 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.142729 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.142922 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.143078 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.143259 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.143415 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.143575 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.143730 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.143897 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.144051 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.144230 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.144375 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.144550 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.144726 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.144971 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.145116 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.146271 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.146440 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.146594 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.146747 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.147023 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.147180 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.147328 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.147483 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.147626 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.147766 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.147912 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.148053 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.148200 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.148350 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.148498 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.148729 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.148909 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.149158 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.149343 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.149343 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.149629 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.149771 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.149919 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.150067 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.150208 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.150359 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.150500 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.150639 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.150789 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.150954 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.150954 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.151238 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.151386 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.151527 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.151674 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.151815 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.151967 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.152116 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.152265 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.152407 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.152546 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.152695 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.152875 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.153025 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.153166 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.153314 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.153462 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.153604 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.153756 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.153898 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.154037 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.154208 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.154364 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.154603 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.154797 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.154964 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.155188 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.155341 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.155481 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.155481 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.155768 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.155909 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.156059 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.156208 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.156355 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.156504 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.156651 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.156854 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.157019 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.157229 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.157383 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.157533 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.157674 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.157821 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.157969 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.158110 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.158264 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.158465 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.158612 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.158860 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.159014 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.159276 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.159487 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.159634 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.159808 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.159955 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.160133 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.160289 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.160443 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.160599 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.160747 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.161004 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.161270 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.161545 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.161739 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.161941 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.162132 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.162282 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.162462 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.162619 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.162768 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.162916 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.163065 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.163213 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.163365 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.163514 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.163719 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.163865 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.164035 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.164189 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.164377 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.164539 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.164688 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.164894 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.165053 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.165212 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.165458 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.165613 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.165762 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.165904 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.166060 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.166209 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.166361 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.166503 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.166643 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.166782 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.166930 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.167077 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.167256 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.167503 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.167650 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.167797 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.167939 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.168088 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.168229 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.168376 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.168517 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.168659 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.168840 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.169080 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.169292 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.169528 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.169731 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.169886 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.170055 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.170217 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.170375 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.170523 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.170690 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.170853 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.171072 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.171234 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.171555 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.171708 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.171965 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.172135 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.172297 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.172452 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.172599 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.172754 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.172985 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.173143 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.173299 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.173446 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.173599 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.173753 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.173912 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.174058 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.174213 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.174360 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.174506 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.174653 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.174799 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.174959 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.175106 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.175251 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.175397 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.175631 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.175791 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.175963 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.176115 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.176270 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.176417 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.176694 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.176934 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.177135 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.177325 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.177606 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.177805 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.177960 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.178123 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.178290 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.178445 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.178600 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.178760 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.178908 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.179163 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.179380 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.179646 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.179802 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.179948 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.180096 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.180251 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.180409 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.180555 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.180708 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.180896 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.181055 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.181204 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.181350 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.181502 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.181657 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.181805 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.181963 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.182198 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.182362 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.182528 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.182684 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.182838 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.182995 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.183150 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.183297 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.183451 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.183606 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.183766 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.183913 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.184059 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.184215 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.184363 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.184527 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.184682 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.184863 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.185025 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.185180 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.185336 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.185483 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.185728 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.185965 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.186125 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.186292 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.186441 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.186598 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.186754 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.186908 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.187062 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.187209 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.187354 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.187510 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.187746 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.187898 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.188044 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.188198 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.188345 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.188345 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.188650 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.188828 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.188990 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.189139 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.189441 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.189616 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.189865 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.190016 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.190202 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.190359 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.190507 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.190663 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.190812 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.190969 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.191174 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.191344 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.191502 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.191650 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.191856 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.192049 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.192891 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.193144 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.193535 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.193695 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.193943 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.194110 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.194291 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.194454 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.194611 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.194767 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.194921 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.195069 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.195215 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.195361 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.195539 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.195696 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.195851 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.196114 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.196284 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.196446 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.196599 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.196758 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.196958 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.197105 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.197251 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.197409 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.197565 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.197739 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.197964 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.198125 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.198273 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.198444 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.198600 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.198747 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.198980 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.199128 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.199283 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.199564 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.199718 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.199882 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.200117 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.200117 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.200430 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.200597 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.200745 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.200925 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.201083 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.201231 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.201389 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.201544 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.201698 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.201851 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.202011 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.202159 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.202313 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.202460 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.202616 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.202762 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.202995 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.203163 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.203318 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.203466 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.203612 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.203759 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.203905 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.204059 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.204211 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.204366 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.204520 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.204678 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.204846 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.205015 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.205015 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.205313 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.205619 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.205938 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.206274 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.206683 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.206920 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.207136 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.207300 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.207503 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.207692 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.208468 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.208634 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.208987 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.209156 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.209334 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.209672 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.209833 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.209982 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.210292 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.210453 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.210614 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.210770 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.210935 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.211125 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.211287 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.211489 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.211651 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.211808 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.211963 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.212110 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.212255 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.212408 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.212564 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.212730 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.212909 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.213352 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.213622 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.213715 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.213971 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.216795 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.216928 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.216928 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.217098 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.217203 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.217309 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.217397 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.217486 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.217579 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.217667 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.217761 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.217855 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.217948 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.218034 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.218118 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.218209 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.218303 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.218303 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.218303 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.218543 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.218629 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.218629 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.218629 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.218629 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.218939 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.219115 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.219217 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.219499 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.219708 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.219814 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.220136 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.220296 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.220472 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.220826 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.220945 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.221155 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.221436 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.221537 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.221799 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.222065 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.222166 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.222429 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.222677 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.222788 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.223054 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.223278 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.224108 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.224199 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.224459 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.224727 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.225004 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.225105 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.225409 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.225596 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.225742 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.226069 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.226170 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.226401 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.226691 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.226799 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.227027 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.227284 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.227386 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.227669 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.227885 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.227976 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.228291 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.228490 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.228610 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.228977 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.229115 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.229300 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.229618 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.229739 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.229939 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.230263 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.230406 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.230580 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.230914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.231028 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.231246 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.231506 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.231601 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.231875 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.232115 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.232217 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.232548 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.232695 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.232908 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.233240 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.233353 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.233585 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.233845 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.233937 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.234212 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.234444 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.234555 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.234765 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 03:29:29.235047 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.235469 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.235912 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.236367 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.236834 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.237270 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.237690 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.238110 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.238528 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.239041 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.240077 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.240373 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.240811 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.241253 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.241667 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.242094 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.242515 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.243197 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.243615 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.244041 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.244459 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.244949 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.245343 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.245761 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.246180 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.246649 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.247016 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.247436 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.247854 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.248271 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.248688 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.249124 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.249571 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.250019 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.250503 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.250894 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.251322 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.251760 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.252190 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.252624 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.253100 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.253535 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.253959 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.254405 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.255463 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.255900 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.256329 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.256788 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.257219 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.257646 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.258082 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.258526 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.258949 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.259391 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.259824 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.260314 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.260682 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.261127 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.261570 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.262025 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.262448 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.262872 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.263298 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.263724 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.264155 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.264581 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.265031 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.265510 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.266212 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.266392 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.266868 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.267262 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.267827 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.268132 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.268600 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.271556 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.271556 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.271556 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.271556 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.271556 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.271556 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:29:29.272225 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 03:29:29.302500 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO dbcounter [None req-29fb8b29-65b5-464a-a234-3ef13407f4d0 None None] Registered counter for database nova_api Aug 24 03:29:29.323560 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_db.sqlalchemy.engines [None req-29fb8b29-65b5-464a-a234-3ef13407f4d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120708) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:29:29.330641 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writer thread running {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:29:29.337750 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO dbcounter [None req-77330d2e-0f5b-4a2e-a49c-cf5282c59dd9 None None] Registered counter for database nova_api Aug 24 03:29:29.358320 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_db.sqlalchemy.engines [None req-77330d2e-0f5b-4a2e-a49c-cf5282c59dd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120709) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:29:29.365700 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writer thread running {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:29:29.388504 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.context [None req-29fb8b29-65b5-464a-a234-3ef13407f4d0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ed5b7d00-8e19-4d94-83cc-5821156784d7(cell1) {{(pid=120708) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 03:29:29.392609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-29fb8b29-65b5-464a-a234-3ef13407f4d0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:29.393110 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-29fb8b29-65b5-464a-a234-3ef13407f4d0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:29.394753 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-29fb8b29-65b5-464a-a234-3ef13407f4d0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:29.396572 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-29fb8b29-65b5-464a-a234-3ef13407f4d0 None None] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:29.397113 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-29fb8b29-65b5-464a-a234-3ef13407f4d0 None None] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:29.399044 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-29fb8b29-65b5-464a-a234-3ef13407f4d0 None None] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:29.401070 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO dbcounter [None req-29fb8b29-65b5-464a-a234-3ef13407f4d0 None None] Registered counter for database nova_cell0 Aug 24 03:29:29.405127 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO dbcounter [None req-29fb8b29-65b5-464a-a234-3ef13407f4d0 None None] Registered counter for database nova_cell1 Aug 24 03:29:29.414138 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_db.sqlalchemy.engines [None req-29fb8b29-65b5-464a-a234-3ef13407f4d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120708) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:29:29.416246 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_db.sqlalchemy.engines [None req-29fb8b29-65b5-464a-a234-3ef13407f4d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120708) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:29:29.423592 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.context [None req-77330d2e-0f5b-4a2e-a49c-cf5282c59dd9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ed5b7d00-8e19-4d94-83cc-5821156784d7(cell1) {{(pid=120709) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 03:29:29.423794 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writer thread running {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:29:29.426414 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writer thread running {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:29:29.427887 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-77330d2e-0f5b-4a2e-a49c-cf5282c59dd9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:29.428379 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-77330d2e-0f5b-4a2e-a49c-cf5282c59dd9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:29.430010 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-77330d2e-0f5b-4a2e-a49c-cf5282c59dd9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:29.430791 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-77330d2e-0f5b-4a2e-a49c-cf5282c59dd9 None None] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:29.431237 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-77330d2e-0f5b-4a2e-a49c-cf5282c59dd9 None None] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:29.433301 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-77330d2e-0f5b-4a2e-a49c-cf5282c59dd9 None None] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:29.435333 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO dbcounter [None req-77330d2e-0f5b-4a2e-a49c-cf5282c59dd9 None None] Registered counter for database nova_cell0 Aug 24 03:29:29.439605 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO dbcounter [None req-77330d2e-0f5b-4a2e-a49c-cf5282c59dd9 None None] Registered counter for database nova_cell1 Aug 24 03:29:29.448011 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_db.sqlalchemy.engines [None req-77330d2e-0f5b-4a2e-a49c-cf5282c59dd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120709) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:29:29.449929 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_db.sqlalchemy.engines [None req-77330d2e-0f5b-4a2e-a49c-cf5282c59dd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120709) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:29:29.455610 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writer thread running {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:29:29.461515 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writer thread running {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:29:29.580791 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO dbcounter [None req-29fb8b29-65b5-464a-a234-3ef13407f4d0 None None] Registered counter for database nova_cell0 Aug 24 03:29:29.588845 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_db.sqlalchemy.engines [None req-29fb8b29-65b5-464a-a234-3ef13407f4d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120708) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:29:29.594065 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writer thread running {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:29:29.612630 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO dbcounter [None req-77330d2e-0f5b-4a2e-a49c-cf5282c59dd9 None None] Registered counter for database nova_cell0 Aug 24 03:29:29.623632 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_db.sqlalchemy.engines [None req-77330d2e-0f5b-4a2e-a49c-cf5282c59dd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120709) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:29:29.630940 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writer thread running {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:29:29.972121 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: WARNING keystonemiddleware.auth_token [None req-29fb8b29-65b5-464a-a234-3ef13407f4d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:29:29.980709 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: WARNING keystonemiddleware.auth_token [None req-29fb8b29-65b5-464a-a234-3ef13407f4d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:29:30.016790 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: WARNING keystonemiddleware.auth_token [None req-77330d2e-0f5b-4a2e-a49c-cf5282c59dd9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:29:30.024956 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: WARNING keystonemiddleware.auth_token [None req-77330d2e-0f5b-4a2e-a49c-cf5282c59dd9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:29:30.326935 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: WARNING keystonemiddleware.auth_token [None req-29fb8b29-65b5-464a-a234-3ef13407f4d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:29:30.333287 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: WARNING keystonemiddleware.auth_token [None req-29fb8b29-65b5-464a-a234-3ef13407f4d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:29:30.339218 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f106ce39c0 pid: 120708 (default app) Aug 24 03:29:30.438615 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: WARNING keystonemiddleware.auth_token [None req-77330d2e-0f5b-4a2e-a49c-cf5282c59dd9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:29:30.448082 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: WARNING keystonemiddleware.auth_token [None req-77330d2e-0f5b-4a2e-a49c-cf5282c59dd9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:29:30.455292 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f106ce39c0 pid: 120709 (default app) Aug 24 03:30:06.372029 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=3 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:06.372029 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=3 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:06.372029 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=3 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:06.372029 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=3 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:06.503846 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_api:SELECT=3 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:06.505421 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell1:SELECT=3 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:06.506885 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell0:SELECT=3 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:06.508678 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell0:SELECT=3 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:08.298985 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-402f2848-87ac-4922-b990-c7612cfdb26e tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] Action: 'create', calling method: .version_select at 0x7f94353b8700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-139126174"}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:08.588656 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-bbfdbc22-3bea-4ba7-abd1-e0af72a0c77f tempest-VolumesNegativeTest-1579394509 tempest-VolumesNegativeTest-1579394509-project] Action: 'create', calling method: .version_select at 0x7f94353bc5e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1577574420", "metadata": {"Type": "work"}}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:08.603037 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-bbfdbc22-3bea-4ba7-abd1-e0af72a0c77f tempest-VolumesNegativeTest-1579394509 tempest-VolumesNegativeTest-1579394509-project] Request method failure captured: Aug 24 03:30:08.603037 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 03:30:08.603037 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept: application/json Aug 24 03:30:08.603037 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept-Encoding: identity Aug 24 03:30:08.603037 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Connection: close Aug 24 03:30:08.603037 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Length: 122 Aug 24 03:30:08.603037 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Type: application/json Aug 24 03:30:08.603037 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Host: 10.222.0.81 Aug 24 03:30:08.603037 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Openstack-System-Scope: None Aug 24 03:30:08.603037 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:08.603037 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Auth-Token: gAAAAABjBZs-RT-1mKklrZFWsbU8PzQ-fuLH1TDzDvNxSyyt5-lDOrprGWocgDj2GbuOm0tH1Ikqz_cOtOWAysgjSKahbnK_55-WsHlRxcvOscltx0L_sKY3WaqUmKf6JclZwiq8ZU5AOYSwginJ_dHfiEok7HX2qi7weW4buaL5X5m4qogkgHo Aug 24 03:30:08.603037 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Id: None Aug 24 03:30:08.603037 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Name: None Aug 24 03:30:08.603037 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Identity-Status: Confirmed Aug 24 03:30:08.603037 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Is-Admin-Project: True Aug 24 03:30:08.603037 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Id: default Aug 24 03:30:08.603037 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Name: Default Aug 24 03:30:08.603037 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Id: 6f655a873ed64b69ac5108f587f8e040 Aug 24 03:30:08.603037 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Name: tempest-VolumesNegativeTest-1579394509 Aug 24 03:30:08.603037 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Role: reader,member Aug 24 03:30:08.603037 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Roles: reader,member Aug 24 03:30:08.604811 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6f655a873ed64b69ac5108f587f8e040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6f655a873ed64b69ac5108f587f8e040", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6f655a873ed64b69ac5108f587f8e040"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6f655a873ed64b69ac5108f587f8e040"}]}] Aug 24 03:30:08.604811 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant: tempest-VolumesNegativeTest-1579394509 Aug 24 03:30:08.604811 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Id: 6f655a873ed64b69ac5108f587f8e040 Aug 24 03:30:08.604811 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Name: tempest-VolumesNegativeTest-1579394509 Aug 24 03:30:08.604811 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User: tempest-VolumesNegativeTest-1579394509-project Aug 24 03:30:08.604811 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Id: default Aug 24 03:30:08.604811 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Name: Default Aug 24 03:30:08.604811 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Id: e3f543c8ec9f4cdcb7d1dfa0b37c094f Aug 24 03:30:08.604811 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Name: tempest-VolumesNegativeTest-1579394509-project Aug 24 03:30:08.604811 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Aug 24 03:30:08.604811 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1577574420", "metadata": {"Type": "work"}}} Aug 24 03:30:08.604811 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: method: Aug 24 03:30:08.604811 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 03:30:08.605769 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1577574420', 'metadata': {'Type': 'work'}}}} Aug 24 03:30:08.605769 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:08.605769 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:08.605769 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:30:08.605769 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:30:08.605769 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:30:08.605769 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:30:08.605769 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 03:30:08.605769 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:08.605769 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 03:30:08.605769 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 03:30:08.605769 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:08.605769 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 03:30:08.605769 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 03:30:08.605769 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:08.605769 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:08.605769 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:08.605769 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:08.605769 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:08.605769 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:08.605769 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:08.605769 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:08.607357 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:30:08.607357 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:30:08.607357 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:08.607357 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:08.607357 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:30:08.607357 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:30:08.607357 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:30:08.607357 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:30:08.607357 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:30:08.607357 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:30:08.607357 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 03:30:08.607357 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:08.607357 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:08.607357 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:08.607357 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:08.607357 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:08.607357 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:08.607357 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:30:08.607357 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:30:08.608690 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 03:30:08.608690 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:08.613695 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-bbfdbc22-3bea-4ba7-abd1-e0af72a0c77f tempest-VolumesNegativeTest-1579394509 tempest-VolumesNegativeTest-1579394509-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:08.614904 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-bbfdbc22-3bea-4ba7-abd1-e0af72a0c77f tempest-VolumesNegativeTest-1579394509 tempest-VolumesNegativeTest-1579394509-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 2.117143 Aug 24 03:30:08.619095 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 1/1] 10.222.0.81 () {60 vars in 1156 bytes} [Wed Aug 24 03:30:06 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 2123 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:30:08.633449 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-5491bc05-940f-438b-8e3f-77b742ea4fe0 tempest-VolumesNegativeTest-1579394509 tempest-VolumesNegativeTest-1579394509-project] Action: 'create', calling method: .version_select at 0x7f94353bc670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1680206644", "metadata": {"Type": "work"}}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:08.639043 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-5491bc05-940f-438b-8e3f-77b742ea4fe0 tempest-VolumesNegativeTest-1579394509 tempest-VolumesNegativeTest-1579394509-project] Request method failure captured: Aug 24 03:30:08.639043 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 03:30:08.639043 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept: application/json Aug 24 03:30:08.639043 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept-Encoding: identity Aug 24 03:30:08.639043 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Connection: close Aug 24 03:30:08.639043 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Length: 120 Aug 24 03:30:08.639043 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Type: application/json Aug 24 03:30:08.639043 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Host: 10.222.0.81 Aug 24 03:30:08.639043 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Openstack-System-Scope: None Aug 24 03:30:08.639043 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:08.639043 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Auth-Token: gAAAAABjBZs-RT-1mKklrZFWsbU8PzQ-fuLH1TDzDvNxSyyt5-lDOrprGWocgDj2GbuOm0tH1Ikqz_cOtOWAysgjSKahbnK_55-WsHlRxcvOscltx0L_sKY3WaqUmKf6JclZwiq8ZU5AOYSwginJ_dHfiEok7HX2qi7weW4buaL5X5m4qogkgHo Aug 24 03:30:08.639043 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Id: None Aug 24 03:30:08.639043 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Name: None Aug 24 03:30:08.639043 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Identity-Status: Confirmed Aug 24 03:30:08.639043 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Is-Admin-Project: True Aug 24 03:30:08.639043 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Id: default Aug 24 03:30:08.639043 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Name: Default Aug 24 03:30:08.639043 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Id: 6f655a873ed64b69ac5108f587f8e040 Aug 24 03:30:08.639043 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Name: tempest-VolumesNegativeTest-1579394509 Aug 24 03:30:08.639043 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Role: reader,member Aug 24 03:30:08.639043 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Roles: reader,member Aug 24 03:30:08.640541 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6f655a873ed64b69ac5108f587f8e040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6f655a873ed64b69ac5108f587f8e040", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6f655a873ed64b69ac5108f587f8e040"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6f655a873ed64b69ac5108f587f8e040"}]}] Aug 24 03:30:08.640541 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant: tempest-VolumesNegativeTest-1579394509 Aug 24 03:30:08.640541 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Id: 6f655a873ed64b69ac5108f587f8e040 Aug 24 03:30:08.640541 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Name: tempest-VolumesNegativeTest-1579394509 Aug 24 03:30:08.640541 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User: tempest-VolumesNegativeTest-1579394509-project Aug 24 03:30:08.640541 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Id: default Aug 24 03:30:08.640541 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Name: Default Aug 24 03:30:08.640541 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Id: e3f543c8ec9f4cdcb7d1dfa0b37c094f Aug 24 03:30:08.640541 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Name: tempest-VolumesNegativeTest-1579394509-project Aug 24 03:30:08.640541 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Aug 24 03:30:08.640541 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1680206644", "metadata": {"Type": "work"}}} Aug 24 03:30:08.640541 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: method: Aug 24 03:30:08.640541 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 03:30:08.641391 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1680206644', 'metadata': {'Type': 'work'}}}} Aug 24 03:30:08.641391 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:08.641391 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:08.641391 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:30:08.641391 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:30:08.641391 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:30:08.641391 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:30:08.641391 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 03:30:08.641391 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:08.641391 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 03:30:08.641391 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 03:30:08.641391 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:08.641391 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 03:30:08.641391 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi '0' Aug 24 03:30:08.641391 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:08.641391 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:08.641391 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:08.641391 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:08.641391 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:08.641391 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:08.641391 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:08.641391 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:08.642664 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:30:08.642664 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:30:08.642664 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:08.642664 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:08.642664 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:30:08.642664 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:30:08.642664 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:30:08.642664 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:30:08.642664 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:30:08.642664 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:30:08.642664 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 03:30:08.642664 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:08.642664 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:08.642664 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:08.642664 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:08.642664 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:08.642664 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:08.642664 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:30:08.642664 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:30:08.643737 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 03:30:08.643737 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:08.651788 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-5491bc05-940f-438b-8e3f-77b742ea4fe0 tempest-VolumesNegativeTest-1579394509 tempest-VolumesNegativeTest-1579394509-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:08.662364 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-5491bc05-940f-438b-8e3f-77b742ea4fe0 tempest-VolumesNegativeTest-1579394509 tempest-VolumesNegativeTest-1579394509-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.036141 Aug 24 03:30:08.670174 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 2/2] 10.222.0.81 () {60 vars in 1156 bytes} [Wed Aug 24 03:30:08 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:30:08.692537 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-cefc2473-8fc7-462d-aa3d-dc457c093c0e tempest-VolumesNegativeTest-1579394509 tempest-VolumesNegativeTest-1579394509-project] Action: 'create', calling method: .version_select at 0x7f94352f31f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2079352948", "metadata": {"Type": "work"}}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:08.713310 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-cefc2473-8fc7-462d-aa3d-dc457c093c0e tempest-VolumesNegativeTest-1579394509 tempest-VolumesNegativeTest-1579394509-project] Request method failure captured: Aug 24 03:30:08.713310 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 03:30:08.713310 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept: application/json Aug 24 03:30:08.713310 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept-Encoding: identity Aug 24 03:30:08.713310 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Connection: close Aug 24 03:30:08.713310 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Length: 119 Aug 24 03:30:08.713310 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Type: application/json Aug 24 03:30:08.713310 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Host: 10.222.0.81 Aug 24 03:30:08.713310 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Openstack-System-Scope: None Aug 24 03:30:08.713310 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:08.713310 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Auth-Token: gAAAAABjBZs-RT-1mKklrZFWsbU8PzQ-fuLH1TDzDvNxSyyt5-lDOrprGWocgDj2GbuOm0tH1Ikqz_cOtOWAysgjSKahbnK_55-WsHlRxcvOscltx0L_sKY3WaqUmKf6JclZwiq8ZU5AOYSwginJ_dHfiEok7HX2qi7weW4buaL5X5m4qogkgHo Aug 24 03:30:08.713310 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Id: None Aug 24 03:30:08.713310 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Name: None Aug 24 03:30:08.713310 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Identity-Status: Confirmed Aug 24 03:30:08.713310 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Is-Admin-Project: True Aug 24 03:30:08.713310 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Id: default Aug 24 03:30:08.713310 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Name: Default Aug 24 03:30:08.713310 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Id: 6f655a873ed64b69ac5108f587f8e040 Aug 24 03:30:08.713310 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Name: tempest-VolumesNegativeTest-1579394509 Aug 24 03:30:08.713310 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Role: reader,member Aug 24 03:30:08.713310 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Roles: reader,member Aug 24 03:30:08.714611 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6f655a873ed64b69ac5108f587f8e040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6f655a873ed64b69ac5108f587f8e040", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6f655a873ed64b69ac5108f587f8e040"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6f655a873ed64b69ac5108f587f8e040"}]}] Aug 24 03:30:08.714611 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant: tempest-VolumesNegativeTest-1579394509 Aug 24 03:30:08.714611 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Id: 6f655a873ed64b69ac5108f587f8e040 Aug 24 03:30:08.714611 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Name: tempest-VolumesNegativeTest-1579394509 Aug 24 03:30:08.714611 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User: tempest-VolumesNegativeTest-1579394509-project Aug 24 03:30:08.714611 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Id: default Aug 24 03:30:08.714611 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Name: Default Aug 24 03:30:08.714611 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Id: e3f543c8ec9f4cdcb7d1dfa0b37c094f Aug 24 03:30:08.714611 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Name: tempest-VolumesNegativeTest-1579394509-project Aug 24 03:30:08.714611 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Aug 24 03:30:08.714611 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2079352948", "metadata": {"Type": "work"}}} Aug 24 03:30:08.714611 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: method: Aug 24 03:30:08.714611 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 03:30:08.715356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2079352948', 'metadata': {'Type': 'work'}}}} Aug 24 03:30:08.715356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:08.715356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:08.715356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:30:08.715356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:30:08.715356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:30:08.715356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:30:08.715356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 03:30:08.715356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:08.715356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 03:30:08.715356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 03:30:08.715356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:08.715356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 03:30:08.715356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi '' Aug 24 03:30:08.715356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:08.715356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:08.715356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:08.715356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:08.715356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:08.715356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:08.715356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:08.715356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:08.720950 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:30:08.720950 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:30:08.720950 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:08.720950 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:08.720950 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:30:08.720950 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:30:08.720950 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:30:08.720950 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:30:08.720950 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:30:08.720950 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:30:08.720950 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 03:30:08.720950 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:08.720950 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:08.720950 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:08.720950 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:08.720950 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:08.720950 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:08.720950 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:30:08.720950 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:30:08.723337 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 03:30:08.723337 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:08.723337 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-cefc2473-8fc7-462d-aa3d-dc457c093c0e tempest-VolumesNegativeTest-1579394509 tempest-VolumesNegativeTest-1579394509-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:08.723337 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-cefc2473-8fc7-462d-aa3d-dc457c093c0e tempest-VolumesNegativeTest-1579394509 tempest-VolumesNegativeTest-1579394509-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.043053 Aug 24 03:30:08.723337 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 3/3] 10.222.0.81 () {60 vars in 1156 bytes} [Wed Aug 24 03:30:08 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:30:08.744092 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-e3b0cb43-fe70-4eb6-83b2-7ac7a5cc2934 tempest-VolumesNegativeTest-1579394509 tempest-VolumesNegativeTest-1579394509-project] Calling method '.version_select at 0x7f94352f3b80>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:10.178340 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.wsgi [None req-e3b0cb43-fe70-4eb6-83b2-7ac7a5cc2934 tempest-VolumesNegativeTest-1579394509 tempest-VolumesNegativeTest-1579394509-project] HTTP exception thrown: Volume tempest-invalid-965492733 could not be found. Aug 24 03:30:10.185107 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-e3b0cb43-fe70-4eb6-83b2-7ac7a5cc2934 tempest-VolumesNegativeTest-1579394509 tempest-VolumesNegativeTest-1579394509-project] Request method failure captured: Aug 24 03:30:10.185107 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-965492733 HTTP/1.1 Aug 24 03:30:10.185107 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept: application/json Aug 24 03:30:10.185107 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept-Encoding: identity Aug 24 03:30:10.185107 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Connection: close Aug 24 03:30:10.185107 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Length: 0 Aug 24 03:30:10.185107 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Type: application/json Aug 24 03:30:10.185107 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Host: 10.222.0.81 Aug 24 03:30:10.185107 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Openstack-System-Scope: None Aug 24 03:30:10.185107 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:10.185107 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Auth-Token: gAAAAABjBZs-RT-1mKklrZFWsbU8PzQ-fuLH1TDzDvNxSyyt5-lDOrprGWocgDj2GbuOm0tH1Ikqz_cOtOWAysgjSKahbnK_55-WsHlRxcvOscltx0L_sKY3WaqUmKf6JclZwiq8ZU5AOYSwginJ_dHfiEok7HX2qi7weW4buaL5X5m4qogkgHo Aug 24 03:30:10.185107 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Id: None Aug 24 03:30:10.185107 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Name: None Aug 24 03:30:10.185107 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Identity-Status: Confirmed Aug 24 03:30:10.185107 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Is-Admin-Project: True Aug 24 03:30:10.185107 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Id: default Aug 24 03:30:10.185107 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Name: Default Aug 24 03:30:10.185107 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Id: 6f655a873ed64b69ac5108f587f8e040 Aug 24 03:30:10.185107 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Name: tempest-VolumesNegativeTest-1579394509 Aug 24 03:30:10.185107 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Role: reader,member Aug 24 03:30:10.185107 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Roles: reader,member Aug 24 03:30:10.186755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6f655a873ed64b69ac5108f587f8e040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6f655a873ed64b69ac5108f587f8e040", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6f655a873ed64b69ac5108f587f8e040"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6f655a873ed64b69ac5108f587f8e040"}]}] Aug 24 03:30:10.186755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant: tempest-VolumesNegativeTest-1579394509 Aug 24 03:30:10.186755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Id: 6f655a873ed64b69ac5108f587f8e040 Aug 24 03:30:10.186755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Name: tempest-VolumesNegativeTest-1579394509 Aug 24 03:30:10.186755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User: tempest-VolumesNegativeTest-1579394509-project Aug 24 03:30:10.186755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Id: default Aug 24 03:30:10.186755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Name: Default Aug 24 03:30:10.186755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Id: e3f543c8ec9f4cdcb7d1dfa0b37c094f Aug 24 03:30:10.186755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Name: tempest-VolumesNegativeTest-1579394509-project Aug 24 03:30:10.186755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: method: Aug 24 03:30:10.186755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: exception: Volume tempest-invalid-965492733 could not be found. Aug 24 03:30:10.186755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: action_args: {'id': 'tempest-invalid-965492733'} Aug 24 03:30:10.186755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:10.187653 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:10.187653 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:30:10.187653 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:30:10.187653 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 03:30:10.187653 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 03:30:10.187653 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 03:30:10.187653 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 03:30:10.187653 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 03:30:10.187653 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 03:30:10.187653 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 03:30:10.187653 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 03:30:10.187653 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:30:10.187653 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:30:10.187653 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:30:10.187653 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:30:10.187653 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-965492733 could not be found. (HTTP 404) (Request-ID: req-a581deeb-ba4d-4c1c-839c-865ee42f48f9) Aug 24 03:30:10.187653 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:10.187653 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:10.187653 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:10.188930 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:10.188930 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 03:30:10.188930 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 03:30:10.188930 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:30:10.188930 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:30:10.188930 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:30:10.188930 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:30:10.188930 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:30:10.188930 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:30:10.188930 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:30:10.188930 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:30:10.188930 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 03:30:10.188930 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 03:30:10.188930 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 03:30:10.188930 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 03:30:10.188930 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 03:30:10.188930 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 03:30:10.188930 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 03:30:10.188930 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 03:30:10.190100 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:30:10.190100 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:30:10.190100 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:30:10.190100 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:30:10.190100 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-965492733 could not be found. Aug 24 03:30:10.190100 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:10.190100 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:10.190100 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:10.190100 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:10.190100 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:10.190100 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:10.190100 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:10.190100 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:10.190100 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:30:10.190100 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:30:10.190100 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:10.190100 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:10.190100 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 03:30:10.190100 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:30:10.190100 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-965492733 could not be found. Aug 24 03:30:10.191245 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:10.191245 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:10.191245 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:10.191245 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:10.191245 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:10.191245 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:10.191245 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:30:10.191245 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:30:10.191245 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-965492733 could not be found. Aug 24 03:30:10.191245 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:10.191245 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-e3b0cb43-fe70-4eb6-83b2-7ac7a5cc2934 tempest-VolumesNegativeTest-1579394509 tempest-VolumesNegativeTest-1579394509-project] Returning 404 to user: Volume tempest-invalid-965492733 could not be found. {{(pid=120709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:10.191245 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-e3b0cb43-fe70-4eb6-83b2-7ac7a5cc2934 tempest-VolumesNegativeTest-1579394509 tempest-VolumesNegativeTest-1579394509-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/tempest-invalid-965492733" status: 404 len: 98 microversion: 2.1 time: 1.463121 Aug 24 03:30:10.191245 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 4/4] 10.222.0.81 () {58 vars in 1215 bytes} [Wed Aug 24 03:30:08 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-965492733 => generated 98 bytes in 1466 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:30:10.224241 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-da29364c-047f-4021-912b-b9b42e654e7d tempest-VolumesNegativeTest-1579394509 tempest-VolumesNegativeTest-1579394509-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.020599 Aug 24 03:30:10.224715 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 5/5] 10.222.0.81 () {58 vars in 1140 bytes} [Wed Aug 24 03:30:10 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 28 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 03:30:10.249382 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-02652955-0fac-4b97-89be-bf7072691263 tempest-VolumesNegativeTest-1579394509 tempest-VolumesNegativeTest-1579394509-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.013593 Aug 24 03:30:10.259405 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 6/6] 10.222.0.81 () {58 vars in 1137 bytes} [Wed Aug 24 03:30:10 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 27 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 03:30:10.275206 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-36443209-d6e3-47a2-bde8-4db4a0bc60f6 tempest-VolumesNegativeTest-1579394509 tempest-VolumesNegativeTest-1579394509-project] Calling method '.version_select at 0x7f9435227550>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:10.408918 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-402f2848-87ac-4922-b990-c7612cfdb26e tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.121586 Aug 24 03:30:10.410649 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 1/7] 10.222.0.81 () {60 vars in 1155 bytes} [Wed Aug 24 03:30:06 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 4125 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 03:30:10.416963 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d6cedd4f-fa52-4401-8dc5-b6d84fdb9b82 tempest-VolumesTestJSON-1144286626 tempest-VolumesTestJSON-1144286626-project] Calling method '.version_select at 0x7f943528c550>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:10.476981 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.wsgi [None req-36443209-d6e3-47a2-bde8-4db4a0bc60f6 tempest-VolumesNegativeTest-1579394509 tempest-VolumesNegativeTest-1579394509-project] HTTP exception thrown: Volume bb8565a7-2a0e-4a30-8f1b-c53b2e521cd4 could not be found. Aug 24 03:30:10.480180 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-36443209-d6e3-47a2-bde8-4db4a0bc60f6 tempest-VolumesNegativeTest-1579394509 tempest-VolumesNegativeTest-1579394509-project] Request method failure captured: Aug 24 03:30:10.480180 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: request: DELETE /compute/v2.1/os-volumes/bb8565a7-2a0e-4a30-8f1b-c53b2e521cd4 HTTP/1.1 Aug 24 03:30:10.480180 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept: application/json Aug 24 03:30:10.480180 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept-Encoding: identity Aug 24 03:30:10.480180 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Connection: close Aug 24 03:30:10.480180 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Length: 0 Aug 24 03:30:10.480180 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Type: application/json Aug 24 03:30:10.480180 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Host: 10.222.0.81 Aug 24 03:30:10.480180 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Openstack-System-Scope: None Aug 24 03:30:10.480180 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:10.480180 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Auth-Token: gAAAAABjBZs-RT-1mKklrZFWsbU8PzQ-fuLH1TDzDvNxSyyt5-lDOrprGWocgDj2GbuOm0tH1Ikqz_cOtOWAysgjSKahbnK_55-WsHlRxcvOscltx0L_sKY3WaqUmKf6JclZwiq8ZU5AOYSwginJ_dHfiEok7HX2qi7weW4buaL5X5m4qogkgHo Aug 24 03:30:10.480180 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Id: None Aug 24 03:30:10.480180 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Name: None Aug 24 03:30:10.480180 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Identity-Status: Confirmed Aug 24 03:30:10.480180 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Is-Admin-Project: True Aug 24 03:30:10.480180 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Id: default Aug 24 03:30:10.480180 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Name: Default Aug 24 03:30:10.480180 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Id: 6f655a873ed64b69ac5108f587f8e040 Aug 24 03:30:10.480180 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Name: tempest-VolumesNegativeTest-1579394509 Aug 24 03:30:10.480180 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Role: reader,member Aug 24 03:30:10.480180 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Roles: reader,member Aug 24 03:30:10.481690 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6f655a873ed64b69ac5108f587f8e040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6f655a873ed64b69ac5108f587f8e040", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6f655a873ed64b69ac5108f587f8e040"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6f655a873ed64b69ac5108f587f8e040"}]}] Aug 24 03:30:10.481690 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant: tempest-VolumesNegativeTest-1579394509 Aug 24 03:30:10.481690 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Id: 6f655a873ed64b69ac5108f587f8e040 Aug 24 03:30:10.481690 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Name: tempest-VolumesNegativeTest-1579394509 Aug 24 03:30:10.481690 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User: tempest-VolumesNegativeTest-1579394509-project Aug 24 03:30:10.481690 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Id: default Aug 24 03:30:10.481690 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Name: Default Aug 24 03:30:10.481690 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Id: e3f543c8ec9f4cdcb7d1dfa0b37c094f Aug 24 03:30:10.481690 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Name: tempest-VolumesNegativeTest-1579394509-project Aug 24 03:30:10.481690 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: method: Aug 24 03:30:10.481690 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: exception: Volume bb8565a7-2a0e-4a30-8f1b-c53b2e521cd4 could not be found. Aug 24 03:30:10.481690 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: action_args: {'id': 'bb8565a7-2a0e-4a30-8f1b-c53b2e521cd4'} Aug 24 03:30:10.481690 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:10.482553 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:10.482553 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:30:10.482553 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:30:10.482553 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 03:30:10.482553 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 03:30:10.482553 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 03:30:10.482553 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 03:30:10.482553 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 03:30:10.482553 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 03:30:10.482553 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 03:30:10.482553 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 03:30:10.482553 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:30:10.482553 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:30:10.482553 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:30:10.482553 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:30:10.482553 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bb8565a7-2a0e-4a30-8f1b-c53b2e521cd4 could not be found. (HTTP 404) (Request-ID: req-ee255844-fa69-4156-ace0-7a45591555b4) Aug 24 03:30:10.482553 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:10.482553 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:10.482553 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:10.484684 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:10.484684 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 03:30:10.484684 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 03:30:10.484684 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:30:10.484684 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:30:10.484684 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:30:10.484684 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:30:10.484684 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:30:10.484684 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:30:10.484684 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:30:10.484684 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:30:10.484684 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 03:30:10.484684 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 03:30:10.484684 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 03:30:10.484684 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 03:30:10.484684 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 03:30:10.484684 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 03:30:10.484684 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 03:30:10.484684 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 03:30:10.487505 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:30:10.487505 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:30:10.487505 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:30:10.487505 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:30:10.487505 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bb8565a7-2a0e-4a30-8f1b-c53b2e521cd4 could not be found. Aug 24 03:30:10.487505 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:10.487505 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:10.487505 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:10.487505 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:10.487505 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:10.487505 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:10.487505 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:10.487505 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:10.487505 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:30:10.487505 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:30:10.487505 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:10.487505 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:10.487505 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 03:30:10.487505 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:30:10.490266 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bb8565a7-2a0e-4a30-8f1b-c53b2e521cd4 could not be found. Aug 24 03:30:10.490266 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:10.490266 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:10.490266 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:10.490266 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:10.490266 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:10.490266 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:10.490266 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:30:10.490266 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:30:10.490266 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bb8565a7-2a0e-4a30-8f1b-c53b2e521cd4 could not be found. Aug 24 03:30:10.490266 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:10.494070 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-36443209-d6e3-47a2-bde8-4db4a0bc60f6 tempest-VolumesNegativeTest-1579394509 tempest-VolumesNegativeTest-1579394509-project] Returning 404 to user: Volume bb8565a7-2a0e-4a30-8f1b-c53b2e521cd4 could not be found. {{(pid=120709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:10.495107 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-36443209-d6e3-47a2-bde8-4db4a0bc60f6 tempest-VolumesNegativeTest-1579394509 tempest-VolumesNegativeTest-1579394509-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/bb8565a7-2a0e-4a30-8f1b-c53b2e521cd4" status: 404 len: 109 microversion: 2.1 time: 0.230395 Aug 24 03:30:10.501181 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 7/8] 10.222.0.81 () {58 vars in 1248 bytes} [Wed Aug 24 03:30:10 2022] DELETE /compute/v2.1/os-volumes/bb8565a7-2a0e-4a30-8f1b-c53b2e521cd4 => generated 109 bytes in 237 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:30:10.515384 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-28ae765b-289c-46e2-95a3-4208d108da02 tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] Calling method '.version_select at 0x7f9435227430>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:10.721922 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d6cedd4f-fa52-4401-8dc5-b6d84fdb9b82 tempest-VolumesTestJSON-1144286626 tempest-VolumesTestJSON-1144286626-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/97d8220b-2f6a-45c8-9e7b-aa63fc29d7df" status: 200 len: 351 microversion: 2.1 time: 0.309805 Aug 24 03:30:10.723002 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 2/9] 10.222.0.81 () {58 vars in 1245 bytes} [Wed Aug 24 03:30:10 2022] GET /compute/v2.1/os-volumes/97d8220b-2f6a-45c8-9e7b-aa63fc29d7df => generated 351 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:10.727751 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-da97e4bc-7dd0-4814-a4bf-a64b6eb535c0 tempest-VolumesNegativeTest-1579394509 tempest-VolumesNegativeTest-1579394509-project] Calling method '.version_select at 0x7f943528cca0>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:10.842296 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-28ae765b-289c-46e2-95a3-4208d108da02 tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/2724167b-a028-4b41-b473-3bf8258ff7ba" status: 200 len: 345 microversion: 2.1 time: 0.338699 Aug 24 03:30:10.852827 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 8/10] 10.222.0.81 () {58 vars in 1245 bytes} [Wed Aug 24 03:30:10 2022] GET /compute/v2.1/os-volumes/2724167b-a028-4b41-b473-3bf8258ff7ba => generated 345 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:10.857821 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-d195fdf2-b1b3-45b8-949a-12bcee4857f1 tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] Action: 'create', calling method: .version_select at 0x7f9435227b80>, body: {"snapshot": {"volume_id": "2724167b-a028-4b41-b473-3bf8258ff7ba", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-468624228"}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:11.055778 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-da97e4bc-7dd0-4814-a4bf-a64b6eb535c0 tempest-VolumesNegativeTest-1579394509 tempest-VolumesNegativeTest-1579394509-project] HTTP exception thrown: Volume 2b1421de-05ba-477b-824c-e9603cab1700 could not be found. Aug 24 03:30:11.061091 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-da97e4bc-7dd0-4814-a4bf-a64b6eb535c0 tempest-VolumesNegativeTest-1579394509 tempest-VolumesNegativeTest-1579394509-project] Request method failure captured: Aug 24 03:30:11.061091 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/os-volumes/2b1421de-05ba-477b-824c-e9603cab1700 HTTP/1.1 Aug 24 03:30:11.061091 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 24 03:30:11.061091 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 24 03:30:11.061091 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Connection: close Aug 24 03:30:11.061091 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 24 03:30:11.061091 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 24 03:30:11.061091 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Host: 10.222.0.81 Aug 24 03:30:11.061091 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 24 03:30:11.061091 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:11.061091 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjBZs-RT-1mKklrZFWsbU8PzQ-fuLH1TDzDvNxSyyt5-lDOrprGWocgDj2GbuOm0tH1Ikqz_cOtOWAysgjSKahbnK_55-WsHlRxcvOscltx0L_sKY3WaqUmKf6JclZwiq8ZU5AOYSwginJ_dHfiEok7HX2qi7weW4buaL5X5m4qogkgHo Aug 24 03:30:11.061091 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 24 03:30:11.061091 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 24 03:30:11.061091 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 24 03:30:11.061091 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 24 03:30:11.061091 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 24 03:30:11.061091 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 24 03:30:11.061091 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Id: 6f655a873ed64b69ac5108f587f8e040 Aug 24 03:30:11.061091 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-VolumesNegativeTest-1579394509 Aug 24 03:30:11.061091 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 24 03:30:11.061091 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 24 03:30:11.062614 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6f655a873ed64b69ac5108f587f8e040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6f655a873ed64b69ac5108f587f8e040", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6f655a873ed64b69ac5108f587f8e040"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6f655a873ed64b69ac5108f587f8e040"}]}] Aug 24 03:30:11.062614 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-VolumesNegativeTest-1579394509 Aug 24 03:30:11.062614 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 6f655a873ed64b69ac5108f587f8e040 Aug 24 03:30:11.062614 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-VolumesNegativeTest-1579394509 Aug 24 03:30:11.062614 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User: tempest-VolumesNegativeTest-1579394509-project Aug 24 03:30:11.062614 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 24 03:30:11.062614 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 24 03:30:11.062614 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Id: e3f543c8ec9f4cdcb7d1dfa0b37c094f Aug 24 03:30:11.062614 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-VolumesNegativeTest-1579394509-project Aug 24 03:30:11.062614 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: method: Aug 24 03:30:11.062614 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: exception: Volume 2b1421de-05ba-477b-824c-e9603cab1700 could not be found. Aug 24 03:30:11.062614 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: action_args: {'id': '2b1421de-05ba-477b-824c-e9603cab1700'} Aug 24 03:30:11.062614 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:11.063579 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:11.063579 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:30:11.063579 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:30:11.063579 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:30:11.063579 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:30:11.063579 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:30:11.063579 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:30:11.063579 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:30:11.063579 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:30:11.063579 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:30:11.063579 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:30:11.063579 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:30:11.063579 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:30:11.063579 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:30:11.063579 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:30:11.063579 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2b1421de-05ba-477b-824c-e9603cab1700 could not be found. (HTTP 404) (Request-ID: req-7cfdea9e-1788-4396-a11a-8e102335af1d) Aug 24 03:30:11.063579 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:30:11.063579 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:11.063579 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:30:11.065519 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:11.065519 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 03:30:11.065519 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 03:30:11.065519 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:30:11.065519 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:30:11.065519 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:30:11.065519 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:30:11.065519 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:30:11.065519 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:30:11.065519 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:30:11.065519 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:30:11.065519 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:30:11.065519 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:30:11.065519 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:30:11.065519 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:30:11.065519 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:30:11.065519 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:30:11.065519 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:30:11.065519 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:30:11.066850 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:30:11.066850 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:30:11.066850 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:30:11.066850 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:30:11.066850 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2b1421de-05ba-477b-824c-e9603cab1700 could not be found. Aug 24 03:30:11.066850 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:30:11.066850 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:11.066850 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:30:11.066850 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:11.066850 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:11.066850 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:11.066850 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:11.066850 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:11.066850 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:30:11.066850 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:30:11.066850 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:11.066850 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:11.066850 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 03:30:11.066850 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:30:11.069561 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2b1421de-05ba-477b-824c-e9603cab1700 could not be found. Aug 24 03:30:11.069561 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:30:11.069561 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:11.069561 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:30:11.069561 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:11.069561 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:11.069561 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:11.069561 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:30:11.069561 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:30:11.069561 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2b1421de-05ba-477b-824c-e9603cab1700 could not be found. Aug 24 03:30:11.069561 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:30:11.069561 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-da97e4bc-7dd0-4814-a4bf-a64b6eb535c0 tempest-VolumesNegativeTest-1579394509 tempest-VolumesNegativeTest-1579394509-project] Returning 404 to user: Volume 2b1421de-05ba-477b-824c-e9603cab1700 could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:11.069561 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-da97e4bc-7dd0-4814-a4bf-a64b6eb535c0 tempest-VolumesNegativeTest-1579394509 tempest-VolumesNegativeTest-1579394509-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/2b1421de-05ba-477b-824c-e9603cab1700" status: 404 len: 109 microversion: 2.1 time: 0.340442 Aug 24 03:30:11.069561 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 3/11] 10.222.0.81 () {58 vars in 1245 bytes} [Wed Aug 24 03:30:10 2022] GET /compute/v2.1/os-volumes/2b1421de-05ba-477b-824c-e9603cab1700 => generated 109 bytes in 345 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:30:11.640207 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-d195fdf2-b1b3-45b8-949a-12bcee4857f1 tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] 10.222.0.81 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.785758 Aug 24 03:30:11.640799 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 9/12] 10.222.0.81 () {60 vars in 1162 bytes} [Wed Aug 24 03:30:10 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:11.653638 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7a8b4a24-a0ba-4a47-99dd-c7ee198a1392 tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] Calling method '.version_select at 0x7f94352a4d30>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:12.000952 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-7a8b4a24-a0ba-4a47-99dd-c7ee198a1392 tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/0594e6b7-5c63-479c-9e8c-05470201a1e8" status: 200 len: 286 microversion: 2.1 time: 0.351224 Aug 24 03:30:12.001848 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 4/13] 10.222.0.81 () {58 vars in 1251 bytes} [Wed Aug 24 03:30:11 2022] GET /compute/v2.1/os-snapshots/0594e6b7-5c63-479c-9e8c-05470201a1e8 => generated 286 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:12.014835 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-d0643c01-46a0-4d09-b930-1f06f82fb39a tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] Calling method '.version_select at 0x7f9435227280>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:12.275170 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-d0643c01-46a0-4d09-b930-1f06f82fb39a tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.265964 Aug 24 03:30:12.277715 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 10/14] 10.222.0.81 () {58 vars in 1140 bytes} [Wed Aug 24 03:30:12 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:12.290322 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ab8f1745-ee11-413c-872c-3d4f49150650 tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] Calling method '.version_select at 0x7f94352084c0>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:12.416211 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ab8f1745-ee11-413c-872c-3d4f49150650 tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/0594e6b7-5c63-479c-9e8c-05470201a1e8" status: 200 len: 286 microversion: 2.1 time: 0.131238 Aug 24 03:30:12.418766 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 5/15] 10.222.0.81 () {58 vars in 1251 bytes} [Wed Aug 24 03:30:12 2022] GET /compute/v2.1/os-snapshots/0594e6b7-5c63-479c-9e8c-05470201a1e8 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:13.182638 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-bb3661c3-d71f-4ce1-b414-42a777359a85 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1594323479", "imageRef": "b7a40f0c-20c2-44cd-8b0e-f6e73a007d3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:13.424757 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.network.neutron [None req-bb3661c3-d71f-4ce1-b414-42a777359a85 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] validate_networks() for [('2fad991f-cb6d-4aa1-a780-e38bbcc632a1', None, None, None, None, None)] {{(pid=120709) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:30:13.430228 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2faf6bac-7556-485d-85b4-9d6fc8695f4d tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] Calling method '.version_select at 0x7f94352a4ca0>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:13.506513 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2faf6bac-7556-485d-85b4-9d6fc8695f4d tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/0594e6b7-5c63-479c-9e8c-05470201a1e8" status: 200 len: 286 microversion: 2.1 time: 0.080343 Aug 24 03:30:13.507675 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 6/16] 10.222.0.81 () {58 vars in 1251 bytes} [Wed Aug 24 03:30:13 2022] GET /compute/v2.1/os-snapshots/0594e6b7-5c63-479c-9e8c-05470201a1e8 => generated 286 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:14.533368 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4da353e3-8923-40f1-92b1-d0f17b00cb59 tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] Calling method '.version_select at 0x7f9435208700>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:14.657964 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4da353e3-8923-40f1-92b1-d0f17b00cb59 tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/0594e6b7-5c63-479c-9e8c-05470201a1e8" status: 200 len: 286 microversion: 2.1 time: 0.140926 Aug 24 03:30:14.658947 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 7/17] 10.222.0.81 () {58 vars in 1251 bytes} [Wed Aug 24 03:30:14 2022] GET /compute/v2.1/os-snapshots/0594e6b7-5c63-479c-9e8c-05470201a1e8 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:15.672223 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c8ee2884-a0bb-4d66-a87c-b77e8627244c tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] Calling method '.version_select at 0x7f9435208c10>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:15.731110 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c8ee2884-a0bb-4d66-a87c-b77e8627244c tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/0594e6b7-5c63-479c-9e8c-05470201a1e8" status: 200 len: 287 microversion: 2.1 time: 0.063572 Aug 24 03:30:15.737685 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 8/18] 10.222.0.81 () {58 vars in 1251 bytes} [Wed Aug 24 03:30:15 2022] GET /compute/v2.1/os-snapshots/0594e6b7-5c63-479c-9e8c-05470201a1e8 => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:15.743612 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-8603ceac-5753-4bdb-8900-28f30254650a tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] Calling method '.version_select at 0x7f94352081f0>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:15.935799 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-8603ceac-5753-4bdb-8900-28f30254650a tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] 10.222.0.81 "DELETE /compute/v2.1/os-snapshots/0594e6b7-5c63-479c-9e8c-05470201a1e8" status: 202 len: 0 microversion: 2.1 time: 0.196736 Aug 24 03:30:15.941311 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 9/19] 10.222.0.81 () {58 vars in 1254 bytes} [Wed Aug 24 03:30:15 2022] DELETE /compute/v2.1/os-snapshots/0594e6b7-5c63-479c-9e8c-05470201a1e8 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:30:15.947831 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-da09e18d-a1e6-4003-af00-680a9ef51a52 tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] Calling method '.version_select at 0x7f9435208940>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:16.019731 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-da09e18d-a1e6-4003-af00-680a9ef51a52 tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/0594e6b7-5c63-479c-9e8c-05470201a1e8" status: 200 len: 286 microversion: 2.1 time: 0.077167 Aug 24 03:30:16.027163 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 10/20] 10.222.0.81 () {58 vars in 1251 bytes} [Wed Aug 24 03:30:15 2022] GET /compute/v2.1/os-snapshots/0594e6b7-5c63-479c-9e8c-05470201a1e8 => generated 286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:16.053390 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-bb3661c3-d71f-4ce1-b414-42a777359a85 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Flavor limits 0:0:0 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:30:16.059739 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-bb3661c3-d71f-4ce1-b414-42a777359a85 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Image limits 0:0:0 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:30:16.060485 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-bb3661c3-d71f-4ce1-b414-42a777359a85 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Flavor pref 0:0:0 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:30:16.061412 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-bb3661c3-d71f-4ce1-b414-42a777359a85 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Image pref 0:0:0 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:30:16.062050 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-bb3661c3-d71f-4ce1-b414-42a777359a85 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:30:16.097229 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bb3661c3-d71f-4ce1-b414-42a777359a85 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:16.100261 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bb3661c3-d71f-4ce1-b414-42a777359a85 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:16.102892 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bb3661c3-d71f-4ce1-b414-42a777359a85 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:16.105074 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bb3661c3-d71f-4ce1-b414-42a777359a85 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:16.105758 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bb3661c3-d71f-4ce1-b414-42a777359a85 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:16.109032 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bb3661c3-d71f-4ce1-b414-42a777359a85 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:16.164153 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.quota [None req-bb3661c3-d71f-4ce1-b414-42a777359a85 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Getting quotas for project 625e6391470e4018a6c502219b3d2b15. Resources: {'ram', 'instances', 'cores'} {{(pid=120709) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:30:16.175107 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.quota [None req-bb3661c3-d71f-4ce1-b414-42a777359a85 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Getting quotas for user 33b932f3feb342d889155c3c34407a88 and project 625e6391470e4018a6c502219b3d2b15. Resources: {'ram', 'instances', 'cores'} {{(pid=120709) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:30:16.191283 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-bb3661c3-d71f-4ce1-b414-42a777359a85 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Going to run 1 instances... {{(pid=120709) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:30:16.196100 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-bb3661c3-d71f-4ce1-b414-42a777359a85 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b7a40f0c-20c2-44cd-8b0e-f6e73a007d3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120709) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:30:16.346415 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-bb3661c3-d71f-4ce1-b414-42a777359a85 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.567034 Aug 24 03:30:16.347106 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 11/21] 10.222.0.81 () {60 vars in 1147 bytes} [Wed Aug 24 03:30:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 3569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:30:16.365410 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f55303b4-c58b-43c2-ac30-32920ba0fdd9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:16.366910 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f55303b4-c58b-43c2-ac30-32920ba0fdd9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:16.508682 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-c61bfa25-dbbf-42e5-9412-7a3aa53f03f0 tempest-VolumesTestJSON-1144286626 tempest-VolumesTestJSON-1144286626-project] Calling method '.version_select at 0x7f94340b6670>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:16.593800 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f55303b4-c58b-43c2-ac30-32920ba0fdd9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:16.620740 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f55303b4-c58b-43c2-ac30-32920ba0fdd9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1222 microversion: 2.1 time: 0.261860 Aug 24 03:30:16.622240 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 11/22] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:16 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1222 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:16.663835 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-c61bfa25-dbbf-42e5-9412-7a3aa53f03f0 tempest-VolumesTestJSON-1144286626 tempest-VolumesTestJSON-1144286626-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/a39721bc-b30b-4df2-adc8-350c7d39297d" status: 200 len: 351 microversion: 2.1 time: 0.159722 Aug 24 03:30:16.667851 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 12/23] 10.222.0.81 () {58 vars in 1245 bytes} [Wed Aug 24 03:30:16 2022] GET /compute/v2.1/os-volumes/a39721bc-b30b-4df2-adc8-350c7d39297d => generated 351 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:16.913917 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b83a5854-d369-4ec7-8f98-035774425edb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1158500465", "imageRef": "b7a40f0c-20c2-44cd-8b0e-f6e73a007d3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:17.033979 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-9b8f57f4-f549-46de-bb05-fd85b3c0e4f0 tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] Calling method '.version_select at 0x7f94340b6dc0>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:17.312084 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.network.neutron [None req-b83a5854-d369-4ec7-8f98-035774425edb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] validate_networks() for [('2fad991f-cb6d-4aa1-a780-e38bbcc632a1', None, None, None, None, None)] {{(pid=120708) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:30:17.652037 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.wsgi [None req-9b8f57f4-f549-46de-bb05-fd85b3c0e4f0 tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] HTTP exception thrown: Snapshot 0594e6b7-5c63-479c-9e8c-05470201a1e8 could not be found. Aug 24 03:30:17.655127 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-9b8f57f4-f549-46de-bb05-fd85b3c0e4f0 tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] Request method failure captured: Aug 24 03:30:17.655127 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: request: GET /compute/v2.1/os-snapshots/0594e6b7-5c63-479c-9e8c-05470201a1e8 HTTP/1.1 Aug 24 03:30:17.655127 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept: application/json Aug 24 03:30:17.655127 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept-Encoding: identity Aug 24 03:30:17.655127 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Connection: close Aug 24 03:30:17.655127 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Length: 0 Aug 24 03:30:17.655127 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Type: application/json Aug 24 03:30:17.655127 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Host: 10.222.0.81 Aug 24 03:30:17.655127 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Openstack-System-Scope: None Aug 24 03:30:17.655127 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:17.655127 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Auth-Token: gAAAAABjBZs-sw92frJeC-6z2C7Q9gOEaae2oORqz7TDxrLV-Jlle4PT0lOB5JP5r0sa8pFiSX7Y4O3anWa4dJygIIc3D1z-4h0gpS8hbMg6YA6y3FTAT15e3Rwk4uAPSCtCRGzLBISp1WPGdiCd9LIjSaJEE7KZDgztIudL2g9bNwJaXn02QQQ Aug 24 03:30:17.655127 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Id: None Aug 24 03:30:17.655127 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Name: None Aug 24 03:30:17.655127 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Identity-Status: Confirmed Aug 24 03:30:17.655127 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Is-Admin-Project: True Aug 24 03:30:17.655127 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Id: default Aug 24 03:30:17.655127 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Name: Default Aug 24 03:30:17.655127 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Id: 84fe38d4a2f24b5ba577c169f125bf67 Aug 24 03:30:17.655127 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-993224280 Aug 24 03:30:17.655127 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Role: reader,member Aug 24 03:30:17.655127 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Roles: reader,member Aug 24 03:30:17.656528 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/84fe38d4a2f24b5ba577c169f125bf67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_84fe38d4a2f24b5ba577c169f125bf67", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/84fe38d4a2f24b5ba577c169f125bf67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/84fe38d4a2f24b5ba577c169f125bf67"}]}] Aug 24 03:30:17.656528 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant: tempest-VolumesSnapshotsTestJSON-993224280 Aug 24 03:30:17.656528 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Id: 84fe38d4a2f24b5ba577c169f125bf67 Aug 24 03:30:17.656528 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-993224280 Aug 24 03:30:17.656528 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User: tempest-VolumesSnapshotsTestJSON-993224280-project Aug 24 03:30:17.656528 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Id: default Aug 24 03:30:17.656528 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Name: Default Aug 24 03:30:17.656528 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Id: e09d29c12c6e4dd2a0e089f18252cda5 Aug 24 03:30:17.656528 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Name: tempest-VolumesSnapshotsTestJSON-993224280-project Aug 24 03:30:17.656528 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: method: Aug 24 03:30:17.656528 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: exception: Snapshot 0594e6b7-5c63-479c-9e8c-05470201a1e8 could not be found. Aug 24 03:30:17.656528 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: action_args: {'id': '0594e6b7-5c63-479c-9e8c-05470201a1e8'} Aug 24 03:30:17.656528 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:17.657481 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:17.657481 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 03:30:17.657481 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 03:30:17.657481 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 03:30:17.657481 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 03:30:17.657481 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 03:30:17.657481 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 03:30:17.657481 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:30:17.657481 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:30:17.657481 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:30:17.657481 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:30:17.657481 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:30:17.657481 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:30:17.657481 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:30:17.657481 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:30:17.657481 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 0594e6b7-5c63-479c-9e8c-05470201a1e8 could not be found. (HTTP 404) (Request-ID: req-082073b4-8ae9-407c-98a3-7a2118154821) Aug 24 03:30:17.657481 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:17.657481 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:17.658635 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:17.658635 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:17.658635 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 03:30:17.658635 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 03:30:17.658635 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:30:17.658635 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:30:17.658635 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 03:30:17.658635 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 03:30:17.658635 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:30:17.658635 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:30:17.658635 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 03:30:17.658635 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 03:30:17.658635 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 03:30:17.658635 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 03:30:17.658635 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 03:30:17.658635 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 03:30:17.658635 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:30:17.658635 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:30:17.658635 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:30:17.659744 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:30:17.659744 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:30:17.659744 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:30:17.659744 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:30:17.659744 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:30:17.659744 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 0594e6b7-5c63-479c-9e8c-05470201a1e8 could not be found. Aug 24 03:30:17.659744 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:17.659744 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:17.659744 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:17.659744 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:17.659744 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:17.659744 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:17.659744 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:17.659744 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:17.659744 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:30:17.659744 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:30:17.659744 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:17.659744 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:17.659744 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 03:30:17.659744 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:30:17.661606 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 0594e6b7-5c63-479c-9e8c-05470201a1e8 could not be found. Aug 24 03:30:17.661606 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:17.661606 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:17.661606 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:17.661606 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:17.661606 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:17.661606 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:17.661606 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:30:17.661606 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:30:17.661606 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 0594e6b7-5c63-479c-9e8c-05470201a1e8 could not be found. Aug 24 03:30:17.661606 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:30:17.661606 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-9b8f57f4-f549-46de-bb05-fd85b3c0e4f0 tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] Returning 404 to user: Snapshot 0594e6b7-5c63-479c-9e8c-05470201a1e8 could not be found. {{(pid=120709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:17.661606 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-9b8f57f4-f549-46de-bb05-fd85b3c0e4f0 tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/0594e6b7-5c63-479c-9e8c-05470201a1e8" status: 404 len: 111 microversion: 2.1 time: 0.626521 Aug 24 03:30:17.661606 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 13/24] 10.222.0.81 () {58 vars in 1251 bytes} [Wed Aug 24 03:30:17 2022] GET /compute/v2.1/os-snapshots/0594e6b7-5c63-479c-9e8c-05470201a1e8 => generated 111 bytes in 631 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:30:17.683488 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-a2864ce4-b971-46cf-8b62-195c526f1abc tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] Calling method '.version_select at 0x7f94340b65e0>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:18.084552 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-a2864ce4-b971-46cf-8b62-195c526f1abc tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/2724167b-a028-4b41-b473-3bf8258ff7ba" status: 202 len: 0 microversion: 2.1 time: 0.422252 Aug 24 03:30:18.089400 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 14/25] 10.222.0.81 () {58 vars in 1248 bytes} [Wed Aug 24 03:30:17 2022] DELETE /compute/v2.1/os-volumes/2724167b-a028-4b41-b473-3bf8258ff7ba => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:30:18.094853 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-e33c24ed-2c10-45d1-8998-d5601e5630f9 tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] Calling method '.version_select at 0x7f94340cf310>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:18.646476 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-e33c24ed-2c10-45d1-8998-d5601e5630f9 tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/2724167b-a028-4b41-b473-3bf8258ff7ba" status: 200 len: 344 microversion: 2.1 time: 0.555855 Aug 24 03:30:18.647405 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 15/26] 10.222.0.81 () {58 vars in 1245 bytes} [Wed Aug 24 03:30:18 2022] GET /compute/v2.1/os-volumes/2724167b-a028-4b41-b473-3bf8258ff7ba => generated 344 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:19.119712 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-cb75cda6-c2d1-4cef-a9b9-8ae9d66f570a tempest-VolumesTestJSON-1144286626 tempest-VolumesTestJSON-1144286626-project] Calling method '.version_select at 0x7f94340b6940>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:19.219140 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-cb75cda6-c2d1-4cef-a9b9-8ae9d66f570a tempest-VolumesTestJSON-1144286626 tempest-VolumesTestJSON-1144286626-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/a9ce50ea-4c0c-4b0d-915d-d491242c6a3a" status: 200 len: 350 microversion: 2.1 time: 0.111451 Aug 24 03:30:19.227885 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 16/27] 10.222.0.81 () {58 vars in 1245 bytes} [Wed Aug 24 03:30:19 2022] GET /compute/v2.1/os-volumes/a9ce50ea-4c0c-4b0d-915d-d491242c6a3a => generated 350 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:19.237958 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-42d05748-f9ac-4b3b-a075-827d095af3bc tempest-VolumesTestJSON-1144286626 tempest-VolumesTestJSON-1144286626-project] Calling method '.version_select at 0x7f94340b6820>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:19.449352 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-b83a5854-d369-4ec7-8f98-035774425edb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Flavor limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:30:19.449817 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-b83a5854-d369-4ec7-8f98-035774425edb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Image limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:30:19.451365 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-b83a5854-d369-4ec7-8f98-035774425edb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Flavor pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:30:19.451796 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-b83a5854-d369-4ec7-8f98-035774425edb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Image pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:30:19.452267 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-b83a5854-d369-4ec7-8f98-035774425edb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:30:19.487820 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-42d05748-f9ac-4b3b-a075-827d095af3bc tempest-VolumesTestJSON-1144286626 tempest-VolumesTestJSON-1144286626-project] 10.222.0.81 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.257118 Aug 24 03:30:19.488810 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 17/28] 10.222.0.81 () {58 vars in 1134 bytes} [Wed Aug 24 03:30:19 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:19.504104 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-30d60bc4-a02c-4954-927a-165f7f02768c tempest-VolumesTestJSON-1144286626 tempest-VolumesTestJSON-1144286626-project] Calling method '.version_select at 0x7f94340d4040>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:19.510563 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b83a5854-d369-4ec7-8f98-035774425edb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:19.511055 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b83a5854-d369-4ec7-8f98-035774425edb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:19.511495 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b83a5854-d369-4ec7-8f98-035774425edb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:19.512239 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b83a5854-d369-4ec7-8f98-035774425edb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:19.512714 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b83a5854-d369-4ec7-8f98-035774425edb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:19.513154 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b83a5854-d369-4ec7-8f98-035774425edb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:19.630944 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-b83a5854-d369-4ec7-8f98-035774425edb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Getting quotas for project 625e6391470e4018a6c502219b3d2b15. Resources: {'ram', 'instances', 'cores'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:30:19.650751 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-b83a5854-d369-4ec7-8f98-035774425edb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Getting quotas for user 33b932f3feb342d889155c3c34407a88 and project 625e6391470e4018a6c502219b3d2b15. Resources: {'ram', 'instances', 'cores'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:30:19.689051 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-30d60bc4-a02c-4954-927a-165f7f02768c tempest-VolumesTestJSON-1144286626 tempest-VolumesTestJSON-1144286626-project] 10.222.0.81 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.189773 Aug 24 03:30:19.698358 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 18/29] 10.222.0.81 () {58 vars in 1149 bytes} [Wed Aug 24 03:30:19 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:19.698358 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-35abf66f-bff3-45e7-b4c1-0f4029adbc55 tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] Calling method '.version_select at 0x7f94340cfc10>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:19.706320 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-b83a5854-d369-4ec7-8f98-035774425edb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Going to run 1 instances... {{(pid=120708) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:30:19.717393 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-b83a5854-d369-4ec7-8f98-035774425edb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b7a40f0c-20c2-44cd-8b0e-f6e73a007d3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120708) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:30:19.797028 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-35abf66f-bff3-45e7-b4c1-0f4029adbc55 tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/2724167b-a028-4b41-b473-3bf8258ff7ba" status: 200 len: 344 microversion: 2.1 time: 0.105817 Aug 24 03:30:19.797667 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 19/30] 10.222.0.81 () {58 vars in 1245 bytes} [Wed Aug 24 03:30:19 2022] GET /compute/v2.1/os-volumes/2724167b-a028-4b41-b473-3bf8258ff7ba => generated 344 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:19.810422 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-8c7a15b1-7668-43bb-9d32-628d4e887ecf tempest-VolumesTestJSON-1144286626 tempest-VolumesTestJSON-1144286626-project] Calling method '.version_select at 0x7f94340cf040>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:19.925728 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-b83a5854-d369-4ec7-8f98-035774425edb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.019195 Aug 24 03:30:19.928022 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 12/31] 10.222.0.81 () {60 vars in 1147 bytes} [Wed Aug 24 03:30:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 3022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:30:19.954971 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-bd0cd3ac-4a77-46ff-9ce1-e4ab9b2c08cd tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:19.962211 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-bd0cd3ac-4a77-46ff-9ce1-e4ab9b2c08cd tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:20.076794 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-8c7a15b1-7668-43bb-9d32-628d4e887ecf tempest-VolumesTestJSON-1144286626 tempest-VolumesTestJSON-1144286626-project] 10.222.0.81 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.271671 Aug 24 03:30:20.077390 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 20/32] 10.222.0.81 () {58 vars in 1134 bytes} [Wed Aug 24 03:30:19 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:20.094332 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-91136406-e6e5-44b4-84c3-6c74545431b5 tempest-VolumesTestJSON-1144286626 tempest-VolumesTestJSON-1144286626-project] Calling method '.version_select at 0x7f94340d4ee0>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:20.133671 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-bd0cd3ac-4a77-46ff-9ce1-e4ab9b2c08cd tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:20.145124 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-bd0cd3ac-4a77-46ff-9ce1-e4ab9b2c08cd tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1222 microversion: 2.1 time: 0.205260 Aug 24 03:30:20.146198 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 13/33] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:19 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1222 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:20.281472 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-91136406-e6e5-44b4-84c3-6c74545431b5 tempest-VolumesTestJSON-1144286626 tempest-VolumesTestJSON-1144286626-project] 10.222.0.81 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.195209 Aug 24 03:30:20.282039 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 21/34] 10.222.0.81 () {58 vars in 1167 bytes} [Wed Aug 24 03:30:20 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:30:20.296852 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7120b5fe-cb43-44dd-803d-5ab5e4827b90 tempest-VolumesTestJSON-1144286626 tempest-VolumesTestJSON-1144286626-project] Calling method '.version_select at 0x7f94348ba820>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:20.524829 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-7120b5fe-cb43-44dd-803d-5ab5e4827b90 tempest-VolumesTestJSON-1144286626 tempest-VolumesTestJSON-1144286626-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.231795 Aug 24 03:30:20.525841 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 14/35] 10.222.0.81 () {58 vars in 1170 bytes} [Wed Aug 24 03:30:20 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:20.549173 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-e6dd2a7e-d6c0-4537-bc42-a591616ab34c tempest-VolumesTestJSON-1144286626 tempest-VolumesTestJSON-1144286626-project] Calling method '.version_select at 0x7f94340d4160>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:20.752806 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-e6dd2a7e-d6c0-4537-bc42-a591616ab34c tempest-VolumesTestJSON-1144286626 tempest-VolumesTestJSON-1144286626-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.217424 Aug 24 03:30:20.753682 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 22/36] 10.222.0.81 () {58 vars in 1155 bytes} [Wed Aug 24 03:30:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:20.768516 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-77f451f3-3cac-421b-814a-74dc8677854b tempest-VolumesTestJSON-1144286626 tempest-VolumesTestJSON-1144286626-project] Calling method '.version_select at 0x7f94348db160>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:20.812954 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-78e4e435-ca4a-4b6b-99c3-c074fabf17e5 tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] Calling method '.version_select at 0x7f94340b6820>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:20.930729 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-78e4e435-ca4a-4b6b-99c3-c074fabf17e5 tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/2724167b-a028-4b41-b473-3bf8258ff7ba" status: 200 len: 344 microversion: 2.1 time: 0.123437 Aug 24 03:30:20.932054 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 23/37] 10.222.0.81 () {58 vars in 1245 bytes} [Wed Aug 24 03:30:20 2022] GET /compute/v2.1/os-volumes/2724167b-a028-4b41-b473-3bf8258ff7ba => generated 344 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:20.956673 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-77f451f3-3cac-421b-814a-74dc8677854b tempest-VolumesTestJSON-1144286626 tempest-VolumesTestJSON-1144286626-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.193432 Aug 24 03:30:20.957470 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 15/38] 10.222.0.81 () {58 vars in 1188 bytes} [Wed Aug 24 03:30:20 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:20.976564 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-f2d04020-21ea-4bf1-8a7a-545a47a08082 tempest-VolumesTestJSON-1144286626 tempest-VolumesTestJSON-1144286626-project] Calling method '.version_select at 0x7f94340cf790>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:21.099933 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-f2d04020-21ea-4bf1-8a7a-545a47a08082 tempest-VolumesTestJSON-1144286626 tempest-VolumesTestJSON-1144286626-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.127097 Aug 24 03:30:21.115431 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 24/39] 10.222.0.81 () {58 vars in 1155 bytes} [Wed Aug 24 03:30:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:21.169962 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-3dde68fa-40e7-4bf4-9304-2f52d74721a9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:21.170599 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-3dde68fa-40e7-4bf4-9304-2f52d74721a9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:21.354619 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-3dde68fa-40e7-4bf4-9304-2f52d74721a9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:21.377416 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-3dde68fa-40e7-4bf4-9304-2f52d74721a9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1222 microversion: 2.1 time: 0.210874 Aug 24 03:30:21.379257 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 16/40] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:21 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1222 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:21.945603 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-aa29e1de-e608-4a82-a50e-6bb2be458b76 tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] Calling method '.version_select at 0x7f94348db040>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:22.012813 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-aa29e1de-e608-4a82-a50e-6bb2be458b76 tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] HTTP exception thrown: Volume 2724167b-a028-4b41-b473-3bf8258ff7ba could not be found. Aug 24 03:30:22.019734 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-aa29e1de-e608-4a82-a50e-6bb2be458b76 tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] Request method failure captured: Aug 24 03:30:22.019734 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/os-volumes/2724167b-a028-4b41-b473-3bf8258ff7ba HTTP/1.1 Aug 24 03:30:22.019734 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 24 03:30:22.019734 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 24 03:30:22.019734 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Connection: close Aug 24 03:30:22.019734 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 24 03:30:22.019734 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 24 03:30:22.019734 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Host: 10.222.0.81 Aug 24 03:30:22.019734 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 24 03:30:22.019734 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:22.019734 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjBZs-sw92frJeC-6z2C7Q9gOEaae2oORqz7TDxrLV-Jlle4PT0lOB5JP5r0sa8pFiSX7Y4O3anWa4dJygIIc3D1z-4h0gpS8hbMg6YA6y3FTAT15e3Rwk4uAPSCtCRGzLBISp1WPGdiCd9LIjSaJEE7KZDgztIudL2g9bNwJaXn02QQQ Aug 24 03:30:22.019734 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 24 03:30:22.019734 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 24 03:30:22.019734 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 24 03:30:22.019734 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 24 03:30:22.019734 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 24 03:30:22.019734 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 24 03:30:22.019734 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Id: 84fe38d4a2f24b5ba577c169f125bf67 Aug 24 03:30:22.019734 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-993224280 Aug 24 03:30:22.019734 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 24 03:30:22.019734 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 24 03:30:22.020999 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/84fe38d4a2f24b5ba577c169f125bf67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_84fe38d4a2f24b5ba577c169f125bf67", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/84fe38d4a2f24b5ba577c169f125bf67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/84fe38d4a2f24b5ba577c169f125bf67"}]}] Aug 24 03:30:22.020999 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-VolumesSnapshotsTestJSON-993224280 Aug 24 03:30:22.020999 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 84fe38d4a2f24b5ba577c169f125bf67 Aug 24 03:30:22.020999 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-993224280 Aug 24 03:30:22.020999 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User: tempest-VolumesSnapshotsTestJSON-993224280-project Aug 24 03:30:22.020999 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 24 03:30:22.020999 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 24 03:30:22.020999 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Id: e09d29c12c6e4dd2a0e089f18252cda5 Aug 24 03:30:22.020999 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-VolumesSnapshotsTestJSON-993224280-project Aug 24 03:30:22.020999 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: method: Aug 24 03:30:22.020999 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: exception: Volume 2724167b-a028-4b41-b473-3bf8258ff7ba could not be found. Aug 24 03:30:22.020999 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: action_args: {'id': '2724167b-a028-4b41-b473-3bf8258ff7ba'} Aug 24 03:30:22.020999 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:22.021663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:22.021663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:30:22.021663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:30:22.021663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:30:22.021663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:30:22.021663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:30:22.021663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:30:22.021663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:30:22.021663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:30:22.021663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:30:22.021663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:30:22.021663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:30:22.021663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:30:22.021663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:30:22.021663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:30:22.021663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2724167b-a028-4b41-b473-3bf8258ff7ba could not be found. (HTTP 404) (Request-ID: req-25c805fd-7903-4d64-8a0f-58e917bd8324) Aug 24 03:30:22.021663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.021663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:22.021663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.022663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:22.022663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 03:30:22.022663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 03:30:22.022663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:30:22.022663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:30:22.022663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:30:22.022663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:30:22.022663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:30:22.022663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:30:22.022663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:30:22.022663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:30:22.022663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:30:22.022663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:30:22.022663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:30:22.022663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:30:22.022663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:30:22.022663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:30:22.022663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:30:22.022663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:30:22.023542 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:30:22.023542 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:30:22.023542 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:30:22.023542 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:30:22.023542 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2724167b-a028-4b41-b473-3bf8258ff7ba could not be found. Aug 24 03:30:22.023542 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.023542 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:22.023542 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.023542 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:22.023542 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:22.023542 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:22.023542 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:22.023542 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:22.023542 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:30:22.023542 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:30:22.023542 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:22.023542 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:22.023542 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 03:30:22.023542 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:30:22.024549 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2724167b-a028-4b41-b473-3bf8258ff7ba could not be found. Aug 24 03:30:22.024549 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.024549 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:22.024549 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.024549 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:22.024549 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:22.024549 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:22.024549 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:30:22.024549 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:30:22.024549 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2724167b-a028-4b41-b473-3bf8258ff7ba could not be found. Aug 24 03:30:22.024549 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.024549 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-aa29e1de-e608-4a82-a50e-6bb2be458b76 tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] Returning 404 to user: Volume 2724167b-a028-4b41-b473-3bf8258ff7ba could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:22.025785 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-aa29e1de-e608-4a82-a50e-6bb2be458b76 tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/2724167b-a028-4b41-b473-3bf8258ff7ba" status: 404 len: 109 microversion: 2.1 time: 0.083303 Aug 24 03:30:22.027636 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 17/41] 10.222.0.81 () {58 vars in 1245 bytes} [Wed Aug 24 03:30:21 2022] GET /compute/v2.1/os-volumes/2724167b-a028-4b41-b473-3bf8258ff7ba => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:30:22.066248 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2161daef-8cd6-4dae-a0a1-a1c30f73de76 tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] Calling method '.version_select at 0x7f9435208e50>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:22.147071 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-2161daef-8cd6-4dae-a0a1-a1c30f73de76 tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] HTTP exception thrown: Volume 2724167b-a028-4b41-b473-3bf8258ff7ba could not be found. Aug 24 03:30:22.149271 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2161daef-8cd6-4dae-a0a1-a1c30f73de76 tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] Request method failure captured: Aug 24 03:30:22.149271 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: request: DELETE /compute/v2.1/os-volumes/2724167b-a028-4b41-b473-3bf8258ff7ba HTTP/1.1 Aug 24 03:30:22.149271 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 24 03:30:22.149271 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 24 03:30:22.149271 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Connection: close Aug 24 03:30:22.149271 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 24 03:30:22.149271 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 24 03:30:22.149271 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Host: 10.222.0.81 Aug 24 03:30:22.149271 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 24 03:30:22.149271 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:22.149271 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjBZs-sw92frJeC-6z2C7Q9gOEaae2oORqz7TDxrLV-Jlle4PT0lOB5JP5r0sa8pFiSX7Y4O3anWa4dJygIIc3D1z-4h0gpS8hbMg6YA6y3FTAT15e3Rwk4uAPSCtCRGzLBISp1WPGdiCd9LIjSaJEE7KZDgztIudL2g9bNwJaXn02QQQ Aug 24 03:30:22.149271 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 24 03:30:22.149271 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 24 03:30:22.149271 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 24 03:30:22.149271 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 24 03:30:22.149271 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 24 03:30:22.149271 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 24 03:30:22.149271 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Id: 84fe38d4a2f24b5ba577c169f125bf67 Aug 24 03:30:22.149271 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-993224280 Aug 24 03:30:22.149271 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 24 03:30:22.149271 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 24 03:30:22.150491 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/84fe38d4a2f24b5ba577c169f125bf67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_84fe38d4a2f24b5ba577c169f125bf67", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/84fe38d4a2f24b5ba577c169f125bf67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/84fe38d4a2f24b5ba577c169f125bf67"}]}] Aug 24 03:30:22.150491 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-VolumesSnapshotsTestJSON-993224280 Aug 24 03:30:22.150491 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 84fe38d4a2f24b5ba577c169f125bf67 Aug 24 03:30:22.150491 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-993224280 Aug 24 03:30:22.150491 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User: tempest-VolumesSnapshotsTestJSON-993224280-project Aug 24 03:30:22.150491 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 24 03:30:22.150491 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 24 03:30:22.150491 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Id: e09d29c12c6e4dd2a0e089f18252cda5 Aug 24 03:30:22.150491 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-VolumesSnapshotsTestJSON-993224280-project Aug 24 03:30:22.150491 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: method: Aug 24 03:30:22.150491 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: exception: Volume 2724167b-a028-4b41-b473-3bf8258ff7ba could not be found. Aug 24 03:30:22.150491 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: action_args: {'id': '2724167b-a028-4b41-b473-3bf8258ff7ba'} Aug 24 03:30:22.150491 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:22.151098 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:22.151098 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:30:22.151098 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:30:22.151098 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 03:30:22.151098 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 03:30:22.151098 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 03:30:22.151098 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 03:30:22.151098 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 03:30:22.151098 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 03:30:22.151098 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 03:30:22.151098 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 03:30:22.151098 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:30:22.151098 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:30:22.151098 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:30:22.151098 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:30:22.151098 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2724167b-a028-4b41-b473-3bf8258ff7ba could not be found. (HTTP 404) (Request-ID: req-e72abf1d-bc91-4162-816c-2e3b91f749e8) Aug 24 03:30:22.151098 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.151098 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:22.151098 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.152048 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:22.152048 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 03:30:22.152048 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 03:30:22.152048 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:30:22.152048 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:30:22.152048 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:30:22.152048 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:30:22.152048 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:30:22.152048 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:30:22.152048 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:30:22.152048 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:30:22.152048 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 03:30:22.152048 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 03:30:22.152048 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 03:30:22.152048 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 03:30:22.152048 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 03:30:22.152048 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 03:30:22.152048 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 03:30:22.152048 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 03:30:22.152943 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:30:22.152943 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:30:22.152943 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:30:22.152943 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:30:22.152943 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2724167b-a028-4b41-b473-3bf8258ff7ba could not be found. Aug 24 03:30:22.152943 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.152943 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:22.152943 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.152943 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:22.152943 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:22.152943 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:22.152943 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:22.152943 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:22.152943 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:30:22.152943 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:30:22.152943 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:22.152943 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:22.152943 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 03:30:22.152943 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:30:22.153794 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2724167b-a028-4b41-b473-3bf8258ff7ba could not be found. Aug 24 03:30:22.153794 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.153794 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:22.153794 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.153794 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:22.153794 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:22.153794 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:22.153794 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:30:22.153794 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:30:22.153794 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2724167b-a028-4b41-b473-3bf8258ff7ba could not be found. Aug 24 03:30:22.153794 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.153794 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2161daef-8cd6-4dae-a0a1-a1c30f73de76 tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] Returning 404 to user: Volume 2724167b-a028-4b41-b473-3bf8258ff7ba could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:22.153794 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2161daef-8cd6-4dae-a0a1-a1c30f73de76 tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/2724167b-a028-4b41-b473-3bf8258ff7ba" status: 404 len: 109 microversion: 2.1 time: 0.117897 Aug 24 03:30:22.153794 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 18/42] 10.222.0.81 () {58 vars in 1248 bytes} [Wed Aug 24 03:30:22 2022] DELETE /compute/v2.1/os-volumes/2724167b-a028-4b41-b473-3bf8258ff7ba => generated 109 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:30:22.176733 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f6e5525d-a5ee-47bb-a9c2-2e86e92cd76d tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] Calling method '.version_select at 0x7f94348dbdc0>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:22.224499 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-76721133-0897-41fb-998f-0345fcd6a7f0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1734540725", "imageRef": "b7a40f0c-20c2-44cd-8b0e-f6e73a007d3e", "flavorRef": "452", "networks": [{"uuid": "6b14dc38-7379-4fb4-8965-3b8960206a88"}]}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:22.254861 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-f6e5525d-a5ee-47bb-a9c2-2e86e92cd76d tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] HTTP exception thrown: Volume 2724167b-a028-4b41-b473-3bf8258ff7ba could not be found. Aug 24 03:30:22.257520 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f6e5525d-a5ee-47bb-a9c2-2e86e92cd76d tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] Request method failure captured: Aug 24 03:30:22.257520 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/os-volumes/2724167b-a028-4b41-b473-3bf8258ff7ba HTTP/1.1 Aug 24 03:30:22.257520 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 24 03:30:22.257520 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 24 03:30:22.257520 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Connection: close Aug 24 03:30:22.257520 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 24 03:30:22.257520 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 24 03:30:22.257520 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Host: 10.222.0.81 Aug 24 03:30:22.257520 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 24 03:30:22.257520 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:22.257520 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjBZs-sw92frJeC-6z2C7Q9gOEaae2oORqz7TDxrLV-Jlle4PT0lOB5JP5r0sa8pFiSX7Y4O3anWa4dJygIIc3D1z-4h0gpS8hbMg6YA6y3FTAT15e3Rwk4uAPSCtCRGzLBISp1WPGdiCd9LIjSaJEE7KZDgztIudL2g9bNwJaXn02QQQ Aug 24 03:30:22.257520 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 24 03:30:22.257520 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 24 03:30:22.257520 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 24 03:30:22.257520 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 24 03:30:22.257520 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 24 03:30:22.257520 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 24 03:30:22.257520 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Id: 84fe38d4a2f24b5ba577c169f125bf67 Aug 24 03:30:22.257520 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-993224280 Aug 24 03:30:22.257520 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 24 03:30:22.257520 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 24 03:30:22.259944 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/84fe38d4a2f24b5ba577c169f125bf67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_84fe38d4a2f24b5ba577c169f125bf67", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/84fe38d4a2f24b5ba577c169f125bf67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/84fe38d4a2f24b5ba577c169f125bf67"}]}] Aug 24 03:30:22.259944 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-VolumesSnapshotsTestJSON-993224280 Aug 24 03:30:22.259944 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 84fe38d4a2f24b5ba577c169f125bf67 Aug 24 03:30:22.259944 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-993224280 Aug 24 03:30:22.259944 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User: tempest-VolumesSnapshotsTestJSON-993224280-project Aug 24 03:30:22.259944 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 24 03:30:22.259944 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 24 03:30:22.259944 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Id: e09d29c12c6e4dd2a0e089f18252cda5 Aug 24 03:30:22.259944 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-VolumesSnapshotsTestJSON-993224280-project Aug 24 03:30:22.259944 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: method: Aug 24 03:30:22.259944 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: exception: Volume 2724167b-a028-4b41-b473-3bf8258ff7ba could not be found. Aug 24 03:30:22.259944 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: action_args: {'id': '2724167b-a028-4b41-b473-3bf8258ff7ba'} Aug 24 03:30:22.259944 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:22.261040 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:22.261040 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:30:22.261040 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:30:22.261040 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:30:22.261040 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:30:22.261040 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:30:22.261040 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:30:22.261040 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:30:22.261040 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:30:22.261040 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:30:22.261040 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:30:22.261040 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:30:22.261040 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:30:22.261040 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:30:22.261040 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:30:22.261040 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2724167b-a028-4b41-b473-3bf8258ff7ba could not be found. (HTTP 404) (Request-ID: req-f3f161c6-04e7-458e-9179-987d047b844a) Aug 24 03:30:22.261040 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.261040 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:22.261040 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.264053 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:22.264053 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 03:30:22.264053 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 03:30:22.264053 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:30:22.264053 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:30:22.264053 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:30:22.264053 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:30:22.264053 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:30:22.264053 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:30:22.264053 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:30:22.264053 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:30:22.264053 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:30:22.264053 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:30:22.264053 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:30:22.264053 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:30:22.264053 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:30:22.264053 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:30:22.264053 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:30:22.264053 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:30:22.267400 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:30:22.267400 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:30:22.267400 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:30:22.267400 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:30:22.267400 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2724167b-a028-4b41-b473-3bf8258ff7ba could not be found. Aug 24 03:30:22.267400 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.267400 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:22.267400 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.267400 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:22.267400 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:22.267400 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:22.267400 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:22.267400 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:22.267400 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:30:22.267400 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:30:22.267400 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:22.267400 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:22.267400 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 03:30:22.267400 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:30:22.270193 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2724167b-a028-4b41-b473-3bf8258ff7ba could not be found. Aug 24 03:30:22.270193 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.270193 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:22.270193 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.270193 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:22.270193 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:22.270193 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:22.270193 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:30:22.270193 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:30:22.270193 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2724167b-a028-4b41-b473-3bf8258ff7ba could not be found. Aug 24 03:30:22.270193 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:30:22.270193 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f6e5525d-a5ee-47bb-a9c2-2e86e92cd76d tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] Returning 404 to user: Volume 2724167b-a028-4b41-b473-3bf8258ff7ba could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:22.270193 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f6e5525d-a5ee-47bb-a9c2-2e86e92cd76d tempest-VolumesSnapshotsTestJSON-993224280 tempest-VolumesSnapshotsTestJSON-993224280-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/2724167b-a028-4b41-b473-3bf8258ff7ba" status: 404 len: 109 microversion: 2.1 time: 0.102476 Aug 24 03:30:22.270193 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 19/43] 10.222.0.81 () {58 vars in 1245 bytes} [Wed Aug 24 03:30:22 2022] GET /compute/v2.1/os-volumes/2724167b-a028-4b41-b473-3bf8258ff7ba => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:30:22.330158 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.network.neutron [None req-76721133-0897-41fb-998f-0345fcd6a7f0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] validate_networks() for [('6b14dc38-7379-4fb4-8965-3b8960206a88', None, None, None, None, None)] {{(pid=120709) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:30:22.416115 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-447cac54-5d13-475f-bd82-53b390a3e246 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:22.417185 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-447cac54-5d13-475f-bd82-53b390a3e246 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:22.445636 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-447cac54-5d13-475f-bd82-53b390a3e246 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:22.447209 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-447cac54-5d13-475f-bd82-53b390a3e246 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:22.449098 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-447cac54-5d13-475f-bd82-53b390a3e246 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:22.452419 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-447cac54-5d13-475f-bd82-53b390a3e246 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:22.454082 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-447cac54-5d13-475f-bd82-53b390a3e246 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:22.456067 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-447cac54-5d13-475f-bd82-53b390a3e246 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:22.867411 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-447cac54-5d13-475f-bd82-53b390a3e246 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:22.915344 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-447cac54-5d13-475f-bd82-53b390a3e246 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1274 microversion: 2.1 time: 0.509772 Aug 24 03:30:22.921234 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 20/44] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:22 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1274 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:23.938455 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-06123eb3-b766-415d-97c3-fb4d97f8ffdf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:23.939866 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-06123eb3-b766-415d-97c3-fb4d97f8ffdf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:23.960482 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06123eb3-b766-415d-97c3-fb4d97f8ffdf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:23.962807 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06123eb3-b766-415d-97c3-fb4d97f8ffdf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:23.963489 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06123eb3-b766-415d-97c3-fb4d97f8ffdf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:23.970354 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06123eb3-b766-415d-97c3-fb4d97f8ffdf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:23.974557 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06123eb3-b766-415d-97c3-fb4d97f8ffdf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:23.978216 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06123eb3-b766-415d-97c3-fb4d97f8ffdf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:24.169504 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-06123eb3-b766-415d-97c3-fb4d97f8ffdf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:24.181650 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-06123eb3-b766-415d-97c3-fb4d97f8ffdf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1280 microversion: 2.1 time: 0.247367 Aug 24 03:30:24.185842 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 21/45] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:23 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1280 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:24.408235 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-76721133-0897-41fb-998f-0345fcd6a7f0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Flavor limits 0:0:0 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:30:24.408795 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-76721133-0897-41fb-998f-0345fcd6a7f0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Image limits 0:0:0 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:30:24.409144 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-76721133-0897-41fb-998f-0345fcd6a7f0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Flavor pref 0:0:0 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:30:24.409582 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-76721133-0897-41fb-998f-0345fcd6a7f0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Image pref 0:0:0 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:30:24.409975 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-76721133-0897-41fb-998f-0345fcd6a7f0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:30:24.428542 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-76721133-0897-41fb-998f-0345fcd6a7f0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:24.429060 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-76721133-0897-41fb-998f-0345fcd6a7f0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:24.429502 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-76721133-0897-41fb-998f-0345fcd6a7f0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:24.430887 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-76721133-0897-41fb-998f-0345fcd6a7f0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:24.431342 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-76721133-0897-41fb-998f-0345fcd6a7f0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:24.431772 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-76721133-0897-41fb-998f-0345fcd6a7f0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:24.453291 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-6bcb2b8d-3e11-4e4f-9a1a-2f44046f7d96 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Action: 'create', calling method: .version_select at 0x7f942ffcb820>, body: {"keypair": {"name": "tempest-keypair-388470747", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJQBp2dIsfvnAeeFR+xtGV/DXlG+8btDlNcnSBBvPvaf9gcXH+YL1qkAPlanqqESesaqHF5JVusu2HWxKZ8cdu5xQwCNzpdJ1Uw415DVe1S8H5gy/alAGcUDFRvRFlWPg=="}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:24.473137 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.quota [None req-76721133-0897-41fb-998f-0345fcd6a7f0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Getting quotas for project 0be0cbafba614105869a0913a21a127b. Resources: {'ram', 'instances', 'cores'} {{(pid=120709) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:30:24.481218 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.quota [None req-76721133-0897-41fb-998f-0345fcd6a7f0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Getting quotas for user ce4bf5ffbf2d47c9b54c4c1e343e8944 and project 0be0cbafba614105869a0913a21a127b. Resources: {'ram', 'instances', 'cores'} {{(pid=120709) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:30:24.486008 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-6bcb2b8d-3e11-4e4f-9a1a-2f44046f7d96 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Getting quotas for project 6a1e9994c1c045c892059d5b80578ba7. Resources: {'key_pairs'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:30:24.498159 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-6bcb2b8d-3e11-4e4f-9a1a-2f44046f7d96 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Getting quotas for user 66900b813b934514a7920ba975a05ec5 and project 6a1e9994c1c045c892059d5b80578ba7. Resources: {'key_pairs'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:30:24.507315 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-76721133-0897-41fb-998f-0345fcd6a7f0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Going to run 1 instances... {{(pid=120709) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:30:24.509958 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-76721133-0897-41fb-998f-0345fcd6a7f0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] [instance: a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b7a40f0c-20c2-44cd-8b0e-f6e73a007d3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120709) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:30:24.595844 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-6bcb2b8d-3e11-4e4f-9a1a-2f44046f7d96 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.404350 Aug 24 03:30:24.602678 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 22/46] 10.222.0.81 () {60 vars in 1159 bytes} [Wed Aug 24 03:30:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:24.686730 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-76721133-0897-41fb-998f-0345fcd6a7f0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.793680 Aug 24 03:30:24.691043 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 25/47] 10.222.0.81 () {60 vars in 1147 bytes} [Wed Aug 24 03:30:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:30:24.703452 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7c53ae6f-a526-4886-954c-6c46eb7e7e4b tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:24.704509 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-7c53ae6f-a526-4886-954c-6c46eb7e7e4b tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] [instance: a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:24.875118 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-7c53ae6f-a526-4886-954c-6c46eb7e7e4b tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bf5ffbf2d47c9b54c4c1e343e8944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be0cbafba614105869a0913a21a127b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:24.882977 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-7c53ae6f-a526-4886-954c-6c46eb7e7e4b tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] 10.222.0.81 "GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f" status: 200 len: 1215 microversion: 2.1 time: 0.184940 Aug 24 03:30:24.884257 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 23/48] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:24 2022] GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f => generated 1215 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:25.223317 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-4fc4c9e4-ece7-4402-85c1-2d883fc49a54 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:25.225836 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-4fc4c9e4-ece7-4402-85c1-2d883fc49a54 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:25.302058 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4fc4c9e4-ece7-4402-85c1-2d883fc49a54 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:25.306666 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4fc4c9e4-ece7-4402-85c1-2d883fc49a54 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:25.307333 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4fc4c9e4-ece7-4402-85c1-2d883fc49a54 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:25.310968 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4fc4c9e4-ece7-4402-85c1-2d883fc49a54 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:25.311566 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4fc4c9e4-ece7-4402-85c1-2d883fc49a54 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:25.312030 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4fc4c9e4-ece7-4402-85c1-2d883fc49a54 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:25.679820 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-4fc4c9e4-ece7-4402-85c1-2d883fc49a54 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:25.721024 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-4fc4c9e4-ece7-4402-85c1-2d883fc49a54 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1280 microversion: 2.1 time: 0.510076 Aug 24 03:30:25.725456 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 26/49] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:25 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1280 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:25.910029 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-3b53b472-f157-4712-bd2a-4f80e2394a42 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:25.911170 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-3b53b472-f157-4712-bd2a-4f80e2394a42 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] [instance: a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:26.135190 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-3b53b472-f157-4712-bd2a-4f80e2394a42 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bf5ffbf2d47c9b54c4c1e343e8944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be0cbafba614105869a0913a21a127b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:26.142433 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-3b53b472-f157-4712-bd2a-4f80e2394a42 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] 10.222.0.81 "GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f" status: 200 len: 1215 microversion: 2.1 time: 0.236541 Aug 24 03:30:26.145116 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 24/50] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:25 2022] GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f => generated 1215 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:26.748921 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-05215437-8b1a-40c3-9d84-a224938e691b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:26.750151 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-05215437-8b1a-40c3-9d84-a224938e691b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:26.759753 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-05215437-8b1a-40c3-9d84-a224938e691b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:26.760977 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-05215437-8b1a-40c3-9d84-a224938e691b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:26.765594 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-05215437-8b1a-40c3-9d84-a224938e691b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:26.766544 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-05215437-8b1a-40c3-9d84-a224938e691b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:26.768402 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-05215437-8b1a-40c3-9d84-a224938e691b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:26.771376 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-05215437-8b1a-40c3-9d84-a224938e691b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:27.242938 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-df586c34-fa15-445e-875f-a25b6cbed85b tempest-VolumesGetTestJSON-1915114772 tempest-VolumesGetTestJSON-1915114772-project] Action: 'create', calling method: .version_select at 0x7f942ffcbaf0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-366396075", "metadata": {"Type": "work"}}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:27.286508 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-05215437-8b1a-40c3-9d84-a224938e691b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:27.312715 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-05215437-8b1a-40c3-9d84-a224938e691b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1280 microversion: 2.1 time: 0.558762 Aug 24 03:30:27.314300 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 27/51] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:26 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1280 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:30:27.354964 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-25541d9d-1bdc-4c9c-8317-7a5ab43f5ea2 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:27.357849 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-25541d9d-1bdc-4c9c-8317-7a5ab43f5ea2 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] [instance: a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:27.398530 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-25541d9d-1bdc-4c9c-8317-7a5ab43f5ea2 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:27.400371 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-25541d9d-1bdc-4c9c-8317-7a5ab43f5ea2 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:27.401661 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-25541d9d-1bdc-4c9c-8317-7a5ab43f5ea2 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:27.405400 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-25541d9d-1bdc-4c9c-8317-7a5ab43f5ea2 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:27.406052 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-25541d9d-1bdc-4c9c-8317-7a5ab43f5ea2 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:27.408202 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-25541d9d-1bdc-4c9c-8317-7a5ab43f5ea2 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:27.612874 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-25541d9d-1bdc-4c9c-8317-7a5ab43f5ea2 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bf5ffbf2d47c9b54c4c1e343e8944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be0cbafba614105869a0913a21a127b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:27.635806 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-25541d9d-1bdc-4c9c-8317-7a5ab43f5ea2 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] 10.222.0.81 "GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f" status: 200 len: 1267 microversion: 2.1 time: 0.305929 Aug 24 03:30:27.636424 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 28/52] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:27 2022] GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f => generated 1267 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:28.347388 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-03e074dd-55e6-4085-bbe6-eec43093d544 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:28.348135 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-03e074dd-55e6-4085-bbe6-eec43093d544 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:28.358528 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-03e074dd-55e6-4085-bbe6-eec43093d544 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:28.363949 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-03e074dd-55e6-4085-bbe6-eec43093d544 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:28.367004 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-03e074dd-55e6-4085-bbe6-eec43093d544 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:28.371884 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-03e074dd-55e6-4085-bbe6-eec43093d544 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:28.372928 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-03e074dd-55e6-4085-bbe6-eec43093d544 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:28.374911 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-03e074dd-55e6-4085-bbe6-eec43093d544 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:28.469393 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-df586c34-fa15-445e-875f-a25b6cbed85b tempest-VolumesGetTestJSON-1915114772 tempest-VolumesGetTestJSON-1915114772-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.498533 Aug 24 03:30:28.487922 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 25/53] 10.222.0.81 () {60 vars in 1156 bytes} [Wed Aug 24 03:30:26 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1518 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 24 03:30:28.505933 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-06b31b74-954e-4422-bf96-bf02bf79e938 tempest-VolumesGetTestJSON-1915114772 tempest-VolumesGetTestJSON-1915114772-project] Calling method '.version_select at 0x7f942ffffc10>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:28.740319 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-06b31b74-954e-4422-bf96-bf02bf79e938 tempest-VolumesGetTestJSON-1915114772 tempest-VolumesGetTestJSON-1915114772-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/9a270dc7-ac18-4322-a9a5-5c4afa4ffe01" status: 200 len: 352 microversion: 2.1 time: 0.250753 Aug 24 03:30:28.755378 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 26/54] 10.222.0.81 () {58 vars in 1245 bytes} [Wed Aug 24 03:30:28 2022] GET /compute/v2.1/os-volumes/9a270dc7-ac18-4322-a9a5-5c4afa4ffe01 => generated 352 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:28.769677 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-8efac4ea-5c5d-4699-a63f-5da26c75d796 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:28.774599 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-8efac4ea-5c5d-4699-a63f-5da26c75d796 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] [instance: a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:28.819159 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-03e074dd-55e6-4085-bbe6-eec43093d544 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:28.828246 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-03e074dd-55e6-4085-bbe6-eec43093d544 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1280 microversion: 2.1 time: 0.484543 Aug 24 03:30:28.830061 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8efac4ea-5c5d-4699-a63f-5da26c75d796 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:28.830638 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8efac4ea-5c5d-4699-a63f-5da26c75d796 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:28.831088 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8efac4ea-5c5d-4699-a63f-5da26c75d796 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:28.831834 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8efac4ea-5c5d-4699-a63f-5da26c75d796 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:28.846204 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 29/55] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:28 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1280 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:28.846560 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8efac4ea-5c5d-4699-a63f-5da26c75d796 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:28.846560 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8efac4ea-5c5d-4699-a63f-5da26c75d796 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:29.569056 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=2 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:29.757379 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-452f2af6-3fd5-473a-b34a-2710824e0c7f tempest-VolumesGetTestJSON-1915114772 tempest-VolumesGetTestJSON-1915114772-project] Calling method '.version_select at 0x7f942fff3940>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:29.881959 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-452f2af6-3fd5-473a-b34a-2710824e0c7f tempest-VolumesGetTestJSON-1915114772 tempest-VolumesGetTestJSON-1915114772-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/9a270dc7-ac18-4322-a9a5-5c4afa4ffe01" status: 200 len: 353 microversion: 2.1 time: 0.128467 Aug 24 03:30:29.882544 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 30/56] 10.222.0.81 () {58 vars in 1245 bytes} [Wed Aug 24 03:30:29 2022] GET /compute/v2.1/os-volumes/9a270dc7-ac18-4322-a9a5-5c4afa4ffe01 => generated 353 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:30:29.917884 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-4413d638-0326-458f-ba7d-2de37d937693 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:29.924977 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-4413d638-0326-458f-ba7d-2de37d937693 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:29.937559 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-8efac4ea-5c5d-4699-a63f-5da26c75d796 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bf5ffbf2d47c9b54c4c1e343e8944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be0cbafba614105869a0913a21a127b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:29.955658 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-8efac4ea-5c5d-4699-a63f-5da26c75d796 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] 10.222.0.81 "GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f" status: 200 len: 1273 microversion: 2.1 time: 1.197440 Aug 24 03:30:29.957512 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 27/57] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:28 2022] GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f => generated 1273 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:29.965019 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4413d638-0326-458f-ba7d-2de37d937693 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:29.965019 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4413d638-0326-458f-ba7d-2de37d937693 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:29.965019 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4413d638-0326-458f-ba7d-2de37d937693 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:29.965470 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4413d638-0326-458f-ba7d-2de37d937693 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:29.965905 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4413d638-0326-458f-ba7d-2de37d937693 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:29.973467 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4413d638-0326-458f-ba7d-2de37d937693 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:29.998312 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-090df3e5-30b7-481e-9fdf-5231dd292006 tempest-VolumesGetTestJSON-1915114772 tempest-VolumesGetTestJSON-1915114772-project] Calling method '.version_select at 0x7f942ffed8b0>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:30.240588 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-090df3e5-30b7-481e-9fdf-5231dd292006 tempest-VolumesGetTestJSON-1915114772 tempest-VolumesGetTestJSON-1915114772-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/9a270dc7-ac18-4322-a9a5-5c4afa4ffe01" status: 200 len: 353 microversion: 2.1 time: 0.266830 Aug 24 03:30:30.247085 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 28/58] 10.222.0.81 () {58 vars in 1245 bytes} [Wed Aug 24 03:30:29 2022] GET /compute/v2.1/os-volumes/9a270dc7-ac18-4322-a9a5-5c4afa4ffe01 => generated 353 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:30.272128 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0bf343d4-9ad3-4504-91c1-1e401f324481 tempest-VolumesGetTestJSON-1915114772 tempest-VolumesGetTestJSON-1915114772-project] Calling method '.version_select at 0x7f9434053700>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:30.482195 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-4413d638-0326-458f-ba7d-2de37d937693 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:30.507210 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0bf343d4-9ad3-4504-91c1-1e401f324481 tempest-VolumesGetTestJSON-1915114772 tempest-VolumesGetTestJSON-1915114772-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/9a270dc7-ac18-4322-a9a5-5c4afa4ffe01" status: 202 len: 0 microversion: 2.1 time: 0.239287 Aug 24 03:30:30.518264 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 29/59] 10.222.0.81 () {58 vars in 1248 bytes} [Wed Aug 24 03:30:30 2022] DELETE /compute/v2.1/os-volumes/9a270dc7-ac18-4322-a9a5-5c4afa4ffe01 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:30:30.551230 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-226c3812-7a58-4c34-bed6-8439a5944cbf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-702203361", "imageRef": "b7a40f0c-20c2-44cd-8b0e-f6e73a007d3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e243b8d3-7de2-4711-8726-42cf22c7a222"}], "security_groups": [{"name": "tempest-securitygroup--584502878"}], "key_name": "tempest-keypair-388470747", "user_data": "}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:30.572388 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-4413d638-0326-458f-ba7d-2de37d937693 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1280 microversion: 2.1 time: 0.687678 Aug 24 03:30:30.573568 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 31/60] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:29 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1280 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:30.588961 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-82f46614-7bd4-419c-88b4-6cac99a67607 tempest-VolumesGetTestJSON-1915114772 tempest-VolumesGetTestJSON-1915114772-project] Calling method '.version_select at 0x7f942fff3700>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:30.695213 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-82f46614-7bd4-419c-88b4-6cac99a67607 tempest-VolumesGetTestJSON-1915114772 tempest-VolumesGetTestJSON-1915114772-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/9a270dc7-ac18-4322-a9a5-5c4afa4ffe01" status: 200 len: 352 microversion: 2.1 time: 0.120416 Aug 24 03:30:30.695803 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 32/61] 10.222.0.81 () {58 vars in 1245 bytes} [Wed Aug 24 03:30:30 2022] GET /compute/v2.1/os-volumes/9a270dc7-ac18-4322-a9a5-5c4afa4ffe01 => generated 352 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:30.982999 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.network.neutron [None req-226c3812-7a58-4c34-bed6-8439a5944cbf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] validate_networks() for [('e243b8d3-7de2-4711-8726-42cf22c7a222', None, None, None, None, None)] {{(pid=120708) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:30:30.995438 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-3c9cf5ad-fe17-4616-ab45-5e8e9db56eee tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:30.996158 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-3c9cf5ad-fe17-4616-ab45-5e8e9db56eee tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] [instance: a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:31.014759 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3c9cf5ad-fe17-4616-ab45-5e8e9db56eee tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:31.015539 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3c9cf5ad-fe17-4616-ab45-5e8e9db56eee tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:31.016233 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3c9cf5ad-fe17-4616-ab45-5e8e9db56eee tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:31.017616 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3c9cf5ad-fe17-4616-ab45-5e8e9db56eee tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:31.018229 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3c9cf5ad-fe17-4616-ab45-5e8e9db56eee tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:31.018821 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3c9cf5ad-fe17-4616-ab45-5e8e9db56eee tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:31.272556 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-3c9cf5ad-fe17-4616-ab45-5e8e9db56eee tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bf5ffbf2d47c9b54c4c1e343e8944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be0cbafba614105869a0913a21a127b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:31.287829 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-3c9cf5ad-fe17-4616-ab45-5e8e9db56eee tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] 10.222.0.81 "GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f" status: 200 len: 1273 microversion: 2.1 time: 0.297060 Aug 24 03:30:31.288414 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 33/62] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:30 2022] GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f => generated 1273 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:30:31.605175 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-a5f1a2fe-630e-41b2-924d-08db51aa9adf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:31.606123 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-a5f1a2fe-630e-41b2-924d-08db51aa9adf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:31.617914 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a5f1a2fe-630e-41b2-924d-08db51aa9adf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:31.633413 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a5f1a2fe-630e-41b2-924d-08db51aa9adf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:31.634164 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a5f1a2fe-630e-41b2-924d-08db51aa9adf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:31.637217 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a5f1a2fe-630e-41b2-924d-08db51aa9adf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:31.643621 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a5f1a2fe-630e-41b2-924d-08db51aa9adf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:31.644350 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a5f1a2fe-630e-41b2-924d-08db51aa9adf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:32.539245 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-a5f1a2fe-630e-41b2-924d-08db51aa9adf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:32.547571 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-a5f1a2fe-630e-41b2-924d-08db51aa9adf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1322 microversion: 2.1 time: 0.948315 Aug 24 03:30:32.557679 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 34/63] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:31 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1322 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:32.562837 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-010f2979-66e4-408c-8327-cf24a98c7283 tempest-VolumesGetTestJSON-1915114772 tempest-VolumesGetTestJSON-1915114772-project] Calling method '.version_select at 0x7f942fff83a0>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:32.708532 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-010f2979-66e4-408c-8327-cf24a98c7283 tempest-VolumesGetTestJSON-1915114772 tempest-VolumesGetTestJSON-1915114772-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/9a270dc7-ac18-4322-a9a5-5c4afa4ffe01" status: 200 len: 352 microversion: 2.1 time: 0.149294 Aug 24 03:30:32.716681 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 35/64] 10.222.0.81 () {58 vars in 1245 bytes} [Wed Aug 24 03:30:32 2022] GET /compute/v2.1/os-volumes/9a270dc7-ac18-4322-a9a5-5c4afa4ffe01 => generated 352 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:32.716984 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-713d3048-9234-4245-88aa-4fe8074dd341 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:32.717604 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-713d3048-9234-4245-88aa-4fe8074dd341 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] [instance: a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:32.738334 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-713d3048-9234-4245-88aa-4fe8074dd341 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:32.738850 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-713d3048-9234-4245-88aa-4fe8074dd341 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:32.739372 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-713d3048-9234-4245-88aa-4fe8074dd341 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:32.740087 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-713d3048-9234-4245-88aa-4fe8074dd341 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:32.751937 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-713d3048-9234-4245-88aa-4fe8074dd341 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:32.753198 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-713d3048-9234-4245-88aa-4fe8074dd341 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:32.883937 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-226c3812-7a58-4c34-bed6-8439a5944cbf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Flavor limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:30:32.885475 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-226c3812-7a58-4c34-bed6-8439a5944cbf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Image limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:30:32.887398 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-226c3812-7a58-4c34-bed6-8439a5944cbf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Flavor pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:30:32.888119 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-226c3812-7a58-4c34-bed6-8439a5944cbf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Image pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:30:32.889294 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-226c3812-7a58-4c34-bed6-8439a5944cbf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:30:32.924466 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-226c3812-7a58-4c34-bed6-8439a5944cbf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:32.925885 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-226c3812-7a58-4c34-bed6-8439a5944cbf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:32.926591 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-226c3812-7a58-4c34-bed6-8439a5944cbf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:32.929409 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-226c3812-7a58-4c34-bed6-8439a5944cbf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:32.930116 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-226c3812-7a58-4c34-bed6-8439a5944cbf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:32.931819 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-226c3812-7a58-4c34-bed6-8439a5944cbf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:32.979289 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-226c3812-7a58-4c34-bed6-8439a5944cbf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Getting quotas for project 6a1e9994c1c045c892059d5b80578ba7. Resources: {'ram', 'instances', 'cores'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:30:32.992194 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-226c3812-7a58-4c34-bed6-8439a5944cbf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Getting quotas for user 66900b813b934514a7920ba975a05ec5 and project 6a1e9994c1c045c892059d5b80578ba7. Resources: {'ram', 'instances', 'cores'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:30:33.035597 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-226c3812-7a58-4c34-bed6-8439a5944cbf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Going to run 1 instances... {{(pid=120708) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:30:33.038714 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-226c3812-7a58-4c34-bed6-8439a5944cbf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b7a40f0c-20c2-44cd-8b0e-f6e73a007d3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120708) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:30:33.179178 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-226c3812-7a58-4c34-bed6-8439a5944cbf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.658673 Aug 24 03:30:33.183118 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 30/65] 10.222.0.81 () {60 vars in 1147 bytes} [Wed Aug 24 03:30:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 2664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:30:33.207531 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-fb20eadc-25b3-4dc2-b3d2-036cb9f4a328 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:33.209362 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-fb20eadc-25b3-4dc2-b3d2-036cb9f4a328 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:33.270607 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-713d3048-9234-4245-88aa-4fe8074dd341 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bf5ffbf2d47c9b54c4c1e343e8944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be0cbafba614105869a0913a21a127b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:33.283720 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-713d3048-9234-4245-88aa-4fe8074dd341 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] 10.222.0.81 "GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f" status: 200 len: 1315 microversion: 2.1 time: 0.571518 Aug 24 03:30:33.285089 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 36/66] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:32 2022] GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f => generated 1315 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:33.420582 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-fb20eadc-25b3-4dc2-b3d2-036cb9f4a328 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:33.432418 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-fb20eadc-25b3-4dc2-b3d2-036cb9f4a328 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1236 microversion: 2.1 time: 0.242344 Aug 24 03:30:33.438962 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 31/67] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:33 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1236 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:33.580146 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-b76efc05-7359-4a0d-9550-58dfdab9fc5b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:33.581689 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-b76efc05-7359-4a0d-9550-58dfdab9fc5b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:33.593286 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b76efc05-7359-4a0d-9550-58dfdab9fc5b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:33.599862 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b76efc05-7359-4a0d-9550-58dfdab9fc5b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:33.602064 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b76efc05-7359-4a0d-9550-58dfdab9fc5b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:33.606697 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b76efc05-7359-4a0d-9550-58dfdab9fc5b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:33.647886 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b76efc05-7359-4a0d-9550-58dfdab9fc5b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.040s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:33.648360 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b76efc05-7359-4a0d-9550-58dfdab9fc5b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:33.724220 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-990d9200-5c9f-4bf4-96ba-5f05e6e8a98d tempest-VolumesGetTestJSON-1915114772 tempest-VolumesGetTestJSON-1915114772-project] Calling method '.version_select at 0x7f942ffed790>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:33.811114 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-990d9200-5c9f-4bf4-96ba-5f05e6e8a98d tempest-VolumesGetTestJSON-1915114772 tempest-VolumesGetTestJSON-1915114772-project] HTTP exception thrown: Volume 9a270dc7-ac18-4322-a9a5-5c4afa4ffe01 could not be found. Aug 24 03:30:33.814575 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-990d9200-5c9f-4bf4-96ba-5f05e6e8a98d tempest-VolumesGetTestJSON-1915114772 tempest-VolumesGetTestJSON-1915114772-project] Request method failure captured: Aug 24 03:30:33.814575 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/os-volumes/9a270dc7-ac18-4322-a9a5-5c4afa4ffe01 HTTP/1.1 Aug 24 03:30:33.814575 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 24 03:30:33.814575 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 24 03:30:33.814575 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Connection: close Aug 24 03:30:33.814575 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 24 03:30:33.814575 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 24 03:30:33.814575 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Host: 10.222.0.81 Aug 24 03:30:33.814575 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 24 03:30:33.814575 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.11 Aug 24 03:30:33.814575 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjBZtSwQLEpvWMMnjGRkf4WfT9WZkAaGEA1FQ1i2XKo_BWfSkvXDNvpoGOxsnXCWn_lYGS4U0qyxA1sSU-y-ep0WhdYaMSCDwn1TRGYq1ram5LgkC1ICU75eLtpcouczTw4p6o8qMa50OBg7oMrWgNXfurOL5QpmLPcZAkaT_jYDM1iqo Aug 24 03:30:33.814575 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 24 03:30:33.814575 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 24 03:30:33.814575 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 24 03:30:33.814575 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 24 03:30:33.814575 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 24 03:30:33.814575 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 24 03:30:33.814575 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Id: 51edea3eb09c48f2b346ae28d5b4feeb Aug 24 03:30:33.814575 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-VolumesGetTestJSON-1915114772 Aug 24 03:30:33.814575 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 24 03:30:33.814575 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 24 03:30:33.815994 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/51edea3eb09c48f2b346ae28d5b4feeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_51edea3eb09c48f2b346ae28d5b4feeb", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/51edea3eb09c48f2b346ae28d5b4feeb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/51edea3eb09c48f2b346ae28d5b4feeb"}]}] Aug 24 03:30:33.815994 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-VolumesGetTestJSON-1915114772 Aug 24 03:30:33.815994 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 51edea3eb09c48f2b346ae28d5b4feeb Aug 24 03:30:33.815994 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-VolumesGetTestJSON-1915114772 Aug 24 03:30:33.815994 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User: tempest-VolumesGetTestJSON-1915114772-project Aug 24 03:30:33.815994 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 24 03:30:33.815994 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 24 03:30:33.815994 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Id: ac0d24dbfe384380871b207c353b9cee Aug 24 03:30:33.815994 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-VolumesGetTestJSON-1915114772-project Aug 24 03:30:33.815994 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: method: Aug 24 03:30:33.815994 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: exception: Volume 9a270dc7-ac18-4322-a9a5-5c4afa4ffe01 could not be found. Aug 24 03:30:33.815994 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: action_args: {'id': '9a270dc7-ac18-4322-a9a5-5c4afa4ffe01'} Aug 24 03:30:33.815994 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:30:33.817002 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:33.817002 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:30:33.817002 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:30:33.817002 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:30:33.817002 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:30:33.817002 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:30:33.817002 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:30:33.817002 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:30:33.817002 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:30:33.817002 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:30:33.817002 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:30:33.817002 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:30:33.817002 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:30:33.817002 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:30:33.817002 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:30:33.817002 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9a270dc7-ac18-4322-a9a5-5c4afa4ffe01 could not be found. (HTTP 404) (Request-ID: req-99f89203-8c55-4285-a847-419f6b13c099) Aug 24 03:30:33.817002 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:30:33.817002 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:33.817002 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:30:33.818609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:33.818609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 03:30:33.818609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 03:30:33.818609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:30:33.818609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:30:33.818609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:30:33.818609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:30:33.818609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:30:33.818609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:30:33.818609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:30:33.818609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:30:33.818609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:30:33.818609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:30:33.818609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:30:33.818609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:30:33.818609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:30:33.818609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:30:33.818609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:30:33.818609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:30:33.821290 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:30:33.821290 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:30:33.821290 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:30:33.821290 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:30:33.821290 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9a270dc7-ac18-4322-a9a5-5c4afa4ffe01 could not be found. Aug 24 03:30:33.821290 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:30:33.821290 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:33.821290 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:30:33.821290 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:33.821290 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:33.821290 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:33.821290 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:30:33.821290 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:30:33.821290 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:30:33.821290 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:30:33.821290 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:30:33.821290 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:30:33.821290 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 03:30:33.821290 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:30:33.824656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9a270dc7-ac18-4322-a9a5-5c4afa4ffe01 could not be found. Aug 24 03:30:33.824656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:30:33.824656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:30:33.824656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:30:33.824656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:30:33.824656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:30:33.824656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:30:33.824656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:30:33.824656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:30:33.824656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9a270dc7-ac18-4322-a9a5-5c4afa4ffe01 could not be found. Aug 24 03:30:33.824656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:30:33.824656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-990d9200-5c9f-4bf4-96ba-5f05e6e8a98d tempest-VolumesGetTestJSON-1915114772 tempest-VolumesGetTestJSON-1915114772-project] Returning 404 to user: Volume 9a270dc7-ac18-4322-a9a5-5c4afa4ffe01 could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:30:33.824656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-990d9200-5c9f-4bf4-96ba-5f05e6e8a98d tempest-VolumesGetTestJSON-1915114772 tempest-VolumesGetTestJSON-1915114772-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/9a270dc7-ac18-4322-a9a5-5c4afa4ffe01" status: 404 len: 109 microversion: 2.1 time: 0.095665 Aug 24 03:30:33.824656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 32/68] 10.222.0.81 () {58 vars in 1245 bytes} [Wed Aug 24 03:30:33 2022] GET /compute/v2.1/os-volumes/9a270dc7-ac18-4322-a9a5-5c4afa4ffe01 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:30:34.330501 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a33d63b5-4946-4d5a-8f12-48a16542ed93 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:34.331189 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a33d63b5-4946-4d5a-8f12-48a16542ed93 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] [instance: a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:34.401148 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a33d63b5-4946-4d5a-8f12-48a16542ed93 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:34.404431 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a33d63b5-4946-4d5a-8f12-48a16542ed93 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:34.412663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a33d63b5-4946-4d5a-8f12-48a16542ed93 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:34.441987 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell0:SELECT=4 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:34.485847 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a33d63b5-4946-4d5a-8f12-48a16542ed93 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:34.493009 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell0:SELECT=12 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:34.494775 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a33d63b5-4946-4d5a-8f12-48a16542ed93 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.069s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:34.499855 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a33d63b5-4946-4d5a-8f12-48a16542ed93 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:35.279317 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-b76efc05-7359-4a0d-9550-58dfdab9fc5b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:35.316191 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-b76efc05-7359-4a0d-9550-58dfdab9fc5b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1322 microversion: 2.1 time: 1.744135 Aug 24 03:30:35.343569 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 37/69] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:33 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1322 bytes in 1773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:35.395751 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-327d1e7e-05d5-4cf1-afb8-f79de599146b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:35.396492 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-327d1e7e-05d5-4cf1-afb8-f79de599146b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:35.443848 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-327d1e7e-05d5-4cf1-afb8-f79de599146b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:35.448849 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-327d1e7e-05d5-4cf1-afb8-f79de599146b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:35.452265 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-327d1e7e-05d5-4cf1-afb8-f79de599146b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:35.457739 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-327d1e7e-05d5-4cf1-afb8-f79de599146b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:35.458222 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-327d1e7e-05d5-4cf1-afb8-f79de599146b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:35.465008 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-327d1e7e-05d5-4cf1-afb8-f79de599146b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:35.642870 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a33d63b5-4946-4d5a-8f12-48a16542ed93 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bf5ffbf2d47c9b54c4c1e343e8944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be0cbafba614105869a0913a21a127b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:35.673751 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a33d63b5-4946-4d5a-8f12-48a16542ed93 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] 10.222.0.81 "GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f" status: 200 len: 1315 microversion: 2.1 time: 1.350547 Aug 24 03:30:35.692066 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 33/70] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:34 2022] GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f => generated 1315 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:30:36.365090 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-775868c1-3443-49ee-a3d0-79ba53f691ce tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:36.365896 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-775868c1-3443-49ee-a3d0-79ba53f691ce tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:36.377565 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-775868c1-3443-49ee-a3d0-79ba53f691ce tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:36.378068 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-775868c1-3443-49ee-a3d0-79ba53f691ce tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:36.378507 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-775868c1-3443-49ee-a3d0-79ba53f691ce tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:36.381243 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-775868c1-3443-49ee-a3d0-79ba53f691ce tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:36.383267 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-775868c1-3443-49ee-a3d0-79ba53f691ce tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:36.385342 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-775868c1-3443-49ee-a3d0-79ba53f691ce tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:36.630366 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-327d1e7e-05d5-4cf1-afb8-f79de599146b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:36.637829 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell1:SELECT=63 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:36.663334 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-327d1e7e-05d5-4cf1-afb8-f79de599146b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1240 microversion: 2.1 time: 1.310840 Aug 24 03:30:36.663917 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 38/71] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:35 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1240 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:36.737304 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-8e4904f8-5496-44a7-822b-8e9747e565a0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:36.743152 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-8e4904f8-5496-44a7-822b-8e9747e565a0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] [instance: a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:36.772013 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=6 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:36.779925 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8e4904f8-5496-44a7-822b-8e9747e565a0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:36.780444 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8e4904f8-5496-44a7-822b-8e9747e565a0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:36.780967 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8e4904f8-5496-44a7-822b-8e9747e565a0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:36.782111 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8e4904f8-5496-44a7-822b-8e9747e565a0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:36.782468 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8e4904f8-5496-44a7-822b-8e9747e565a0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:36.783115 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8e4904f8-5496-44a7-822b-8e9747e565a0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:37.846452 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-775868c1-3443-49ee-a3d0-79ba53f691ce tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:37.858134 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-775868c1-3443-49ee-a3d0-79ba53f691ce tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1322 microversion: 2.1 time: 1.497766 Aug 24 03:30:37.877595 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 34/72] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:36 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1322 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:38.024086 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-8e4904f8-5496-44a7-822b-8e9747e565a0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bf5ffbf2d47c9b54c4c1e343e8944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be0cbafba614105869a0913a21a127b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:38.038948 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-8e4904f8-5496-44a7-822b-8e9747e565a0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] 10.222.0.81 "GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f" status: 200 len: 1315 microversion: 2.1 time: 1.345180 Aug 24 03:30:38.050470 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 39/73] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:36 2022] GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f => generated 1315 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:38.064979 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-591f00e3-a5a6-4df2-9098-9c5140f49901 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:38.072173 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-591f00e3-a5a6-4df2-9098-9c5140f49901 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:38.092445 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-591f00e3-a5a6-4df2-9098-9c5140f49901 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:38.092994 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-591f00e3-a5a6-4df2-9098-9c5140f49901 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:38.094391 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-591f00e3-a5a6-4df2-9098-9c5140f49901 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:38.095140 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-591f00e3-a5a6-4df2-9098-9c5140f49901 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:38.095609 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-591f00e3-a5a6-4df2-9098-9c5140f49901 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:38.096040 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-591f00e3-a5a6-4df2-9098-9c5140f49901 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:38.260314 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-591f00e3-a5a6-4df2-9098-9c5140f49901 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:38.278648 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-591f00e3-a5a6-4df2-9098-9c5140f49901 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1296 microversion: 2.1 time: 0.225006 Aug 24 03:30:38.280137 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 40/74] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:38 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1296 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:38.407542 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-16312fac-b4c0-4089-9be3-8479b29cbdce req-34a4ee41-a0da-4399-be00-2694c9237284 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a844487d-f9fc-4452-843d-d6ac2efb35d6", "tag": "96ac11e6-aaa8-4961-9e5b-62c81b5e9607"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:38.421668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-16312fac-b4c0-4089-9be3-8479b29cbdce req-34a4ee41-a0da-4399-be00-2694c9237284 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:38.422585 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-16312fac-b4c0-4089-9be3-8479b29cbdce req-34a4ee41-a0da-4399-be00-2694c9237284 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:38.423234 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-16312fac-b4c0-4089-9be3-8479b29cbdce req-34a4ee41-a0da-4399-be00-2694c9237284 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:38.450801 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-16312fac-b4c0-4089-9be3-8479b29cbdce req-34a4ee41-a0da-4399-be00-2694c9237284 service nova] Creating event network-changed:96ac11e6-aaa8-4961-9e5b-62c81b5e9607 for instance a844487d-f9fc-4452-843d-d6ac2efb35d6 on hv-cinder-85426 Aug 24 03:30:38.453279 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-16312fac-b4c0-4089-9be3-8479b29cbdce req-34a4ee41-a0da-4399-be00-2694c9237284 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120708) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 03:30:38.453856 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-16312fac-b4c0-4089-9be3-8479b29cbdce req-34a4ee41-a0da-4399-be00-2694c9237284 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120708) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 03:30:38.455898 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ee05735b-567e-45f6-8158-0a8f6e35a196 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:38.456483 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ee05735b-567e-45f6-8158-0a8f6e35a196 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:38.461337 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ee05735b-567e-45f6-8158-0a8f6e35a196 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:38.462858 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ee05735b-567e-45f6-8158-0a8f6e35a196 None None] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:38.464053 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ee05735b-567e-45f6-8158-0a8f6e35a196 None None] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:38.464491 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ee05735b-567e-45f6-8158-0a8f6e35a196 None None] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:38.476789 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.compute.rpcapi [None req-ee05735b-567e-45f6-8158-0a8f6e35a196 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 03:30:38.477883 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ee05735b-567e-45f6-8158-0a8f6e35a196 None None] Releasing lock "compute-rpcapi-router" {{(pid=120708) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 03:30:38.505252 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ee05735b-567e-45f6-8158-0a8f6e35a196 None None] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.625652 Aug 24 03:30:38.512416 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 35/75] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:38.738807 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-5d9e0ad4-e31e-4d67-9d22-7de63bb489bb req-b20a69bc-984f-4e14-9158-d3493e59c231 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fb4b6a3-5be8-48da-a564-3bf08b732fa5", "tag": "75859805-bde6-4c9f-97a2-f33dca1a8545"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:38.753438 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-5d9e0ad4-e31e-4d67-9d22-7de63bb489bb req-b20a69bc-984f-4e14-9158-d3493e59c231 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:38.754379 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-5d9e0ad4-e31e-4d67-9d22-7de63bb489bb req-b20a69bc-984f-4e14-9158-d3493e59c231 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:38.755213 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-5d9e0ad4-e31e-4d67-9d22-7de63bb489bb req-b20a69bc-984f-4e14-9158-d3493e59c231 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:38.787998 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-5d9e0ad4-e31e-4d67-9d22-7de63bb489bb req-b20a69bc-984f-4e14-9158-d3493e59c231 service nova] Creating event network-changed:75859805-bde6-4c9f-97a2-f33dca1a8545 for instance 6fb4b6a3-5be8-48da-a564-3bf08b732fa5 on hv-cinder-85426 Aug 24 03:30:38.789117 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-5d9e0ad4-e31e-4d67-9d22-7de63bb489bb req-b20a69bc-984f-4e14-9158-d3493e59c231 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120709) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 03:30:38.789675 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-5d9e0ad4-e31e-4d67-9d22-7de63bb489bb req-b20a69bc-984f-4e14-9158-d3493e59c231 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120709) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 03:30:38.792062 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d335404e-737b-4e9f-995c-ec31821e8edc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:38.793029 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d335404e-737b-4e9f-995c-ec31821e8edc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:38.793485 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d335404e-737b-4e9f-995c-ec31821e8edc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:38.794235 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d335404e-737b-4e9f-995c-ec31821e8edc None None] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:38.794691 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d335404e-737b-4e9f-995c-ec31821e8edc None None] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:38.795147 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d335404e-737b-4e9f-995c-ec31821e8edc None None] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:38.805863 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.compute.rpcapi [None req-d335404e-737b-4e9f-995c-ec31821e8edc None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 03:30:38.807718 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d335404e-737b-4e9f-995c-ec31821e8edc None None] Releasing lock "compute-rpcapi-router" {{(pid=120709) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 03:30:38.825223 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-d335404e-737b-4e9f-995c-ec31821e8edc None None] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.543670 Aug 24 03:30:38.831222 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 41/76] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:38.881894 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-583a095f-aeb3-4b15-b580-02e748d6b470 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:38.885198 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-583a095f-aeb3-4b15-b580-02e748d6b470 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:38.899874 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-583a095f-aeb3-4b15-b580-02e748d6b470 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:38.901739 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-583a095f-aeb3-4b15-b580-02e748d6b470 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:38.902143 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-583a095f-aeb3-4b15-b580-02e748d6b470 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:38.903232 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-583a095f-aeb3-4b15-b580-02e748d6b470 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:38.917361 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-583a095f-aeb3-4b15-b580-02e748d6b470 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:38.917848 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-583a095f-aeb3-4b15-b580-02e748d6b470 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:39.068463 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-17ae2e76-0fbc-49db-bec5-19075f01e40b tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:39.069301 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-17ae2e76-0fbc-49db-bec5-19075f01e40b tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] [instance: a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:39.080101 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-17ae2e76-0fbc-49db-bec5-19075f01e40b tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:39.080609 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-17ae2e76-0fbc-49db-bec5-19075f01e40b tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:39.081214 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-17ae2e76-0fbc-49db-bec5-19075f01e40b tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:39.082698 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-17ae2e76-0fbc-49db-bec5-19075f01e40b tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:39.083696 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-17ae2e76-0fbc-49db-bec5-19075f01e40b tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:39.084860 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-17ae2e76-0fbc-49db-bec5-19075f01e40b tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:39.107057 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-583a095f-aeb3-4b15-b580-02e748d6b470 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:39.126559 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-583a095f-aeb3-4b15-b580-02e748d6b470 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1322 microversion: 2.1 time: 0.250981 Aug 24 03:30:39.127360 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 36/77] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:38 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:39.279550 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-17ae2e76-0fbc-49db-bec5-19075f01e40b tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bf5ffbf2d47c9b54c4c1e343e8944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be0cbafba614105869a0913a21a127b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:39.289188 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-17ae2e76-0fbc-49db-bec5-19075f01e40b tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] 10.222.0.81 "GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f" status: 200 len: 1315 microversion: 2.1 time: 0.224287 Aug 24 03:30:39.290366 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 42/78] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:39 2022] GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:39.300699 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-9028ea21-1d7f-484f-bdad-408f26de0b5e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:39.301620 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-9028ea21-1d7f-484f-bdad-408f26de0b5e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:39.310889 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9028ea21-1d7f-484f-bdad-408f26de0b5e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:39.310889 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9028ea21-1d7f-484f-bdad-408f26de0b5e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:39.310889 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9028ea21-1d7f-484f-bdad-408f26de0b5e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:39.311535 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9028ea21-1d7f-484f-bdad-408f26de0b5e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:39.311981 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9028ea21-1d7f-484f-bdad-408f26de0b5e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:39.312432 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9028ea21-1d7f-484f-bdad-408f26de0b5e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:39.394919 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-9028ea21-1d7f-484f-bdad-408f26de0b5e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:39.405904 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-9028ea21-1d7f-484f-bdad-408f26de0b5e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1296 microversion: 2.1 time: 0.109450 Aug 24 03:30:39.406473 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 37/79] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:39 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1296 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:40.159497 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-5b26d59a-697d-40c2-a589-ac72a5604cdb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:40.161558 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-5b26d59a-697d-40c2-a589-ac72a5604cdb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:40.172981 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5b26d59a-697d-40c2-a589-ac72a5604cdb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:40.173250 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5b26d59a-697d-40c2-a589-ac72a5604cdb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:40.173691 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5b26d59a-697d-40c2-a589-ac72a5604cdb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:40.174799 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5b26d59a-697d-40c2-a589-ac72a5604cdb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:40.175420 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5b26d59a-697d-40c2-a589-ac72a5604cdb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:40.177869 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5b26d59a-697d-40c2-a589-ac72a5604cdb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:40.312363 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-185945a9-e9f2-407c-83b1-19cd56c4b39c tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:40.313950 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-185945a9-e9f2-407c-83b1-19cd56c4b39c tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] [instance: a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:40.335770 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-185945a9-e9f2-407c-83b1-19cd56c4b39c tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:40.336707 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-185945a9-e9f2-407c-83b1-19cd56c4b39c tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:40.339034 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-185945a9-e9f2-407c-83b1-19cd56c4b39c tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:40.341544 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-185945a9-e9f2-407c-83b1-19cd56c4b39c tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:40.346364 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-185945a9-e9f2-407c-83b1-19cd56c4b39c tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:40.347632 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-185945a9-e9f2-407c-83b1-19cd56c4b39c tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:40.775899 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-5b26d59a-697d-40c2-a589-ac72a5604cdb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:40.791908 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-5b26d59a-697d-40c2-a589-ac72a5604cdb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1322 microversion: 2.1 time: 0.642482 Aug 24 03:30:40.794782 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 43/80] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:40 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1322 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:40.802935 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-255ab5a6-bc72-4701-bb32-231c31019b3e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:40.804165 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-255ab5a6-bc72-4701-bb32-231c31019b3e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:40.827477 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-255ab5a6-bc72-4701-bb32-231c31019b3e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:40.833071 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-255ab5a6-bc72-4701-bb32-231c31019b3e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:40.835970 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-255ab5a6-bc72-4701-bb32-231c31019b3e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:40.837250 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-255ab5a6-bc72-4701-bb32-231c31019b3e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:40.838817 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-255ab5a6-bc72-4701-bb32-231c31019b3e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:40.840015 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-255ab5a6-bc72-4701-bb32-231c31019b3e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:41.198884 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-255ab5a6-bc72-4701-bb32-231c31019b3e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:41.228100 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-255ab5a6-bc72-4701-bb32-231c31019b3e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1306 microversion: 2.1 time: 0.419808 Aug 24 03:30:41.233077 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 44/81] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:40 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1306 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:41.255015 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-185945a9-e9f2-407c-83b1-19cd56c4b39c tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bf5ffbf2d47c9b54c4c1e343e8944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be0cbafba614105869a0913a21a127b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:41.265754 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-006b95af-cc2d-47fa-8bea-04bcaa3d9cae req-191ac9e6-69f4-48df-a361-9537571daec8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f", "tag": "045cb674-6952-47d7-bb5e-17ac22a1ef2e"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:41.274704 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-185945a9-e9f2-407c-83b1-19cd56c4b39c tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] 10.222.0.81 "GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f" status: 200 len: 1315 microversion: 2.1 time: 0.966938 Aug 24 03:30:41.287893 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 38/82] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:40 2022] GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f => generated 1315 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:41.323537 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-006b95af-cc2d-47fa-8bea-04bcaa3d9cae req-191ac9e6-69f4-48df-a361-9537571daec8 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:41.324446 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-006b95af-cc2d-47fa-8bea-04bcaa3d9cae req-191ac9e6-69f4-48df-a361-9537571daec8 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:41.333843 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-006b95af-cc2d-47fa-8bea-04bcaa3d9cae req-191ac9e6-69f4-48df-a361-9537571daec8 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:41.363825 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-006b95af-cc2d-47fa-8bea-04bcaa3d9cae req-191ac9e6-69f4-48df-a361-9537571daec8 service nova] Creating event network-changed:045cb674-6952-47d7-bb5e-17ac22a1ef2e for instance a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f on hv-cinder-85426 Aug 24 03:30:41.396633 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-006b95af-cc2d-47fa-8bea-04bcaa3d9cae req-191ac9e6-69f4-48df-a361-9537571daec8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158733 Aug 24 03:30:41.398814 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 45/83] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:41.818077 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c78308b1-0445-4e4a-b38c-da1042770d65 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:41.820340 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c78308b1-0445-4e4a-b38c-da1042770d65 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:41.830114 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c78308b1-0445-4e4a-b38c-da1042770d65 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:41.834622 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c78308b1-0445-4e4a-b38c-da1042770d65 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:41.835253 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c78308b1-0445-4e4a-b38c-da1042770d65 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:41.836259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c78308b1-0445-4e4a-b38c-da1042770d65 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:41.836901 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c78308b1-0445-4e4a-b38c-da1042770d65 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:41.840194 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c78308b1-0445-4e4a-b38c-da1042770d65 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:42.252456 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-efa5ad3d-4b2d-4683-a3cd-ffeeab387697 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:42.254181 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-efa5ad3d-4b2d-4683-a3cd-ffeeab387697 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:42.266914 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-efa5ad3d-4b2d-4683-a3cd-ffeeab387697 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:42.268148 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-efa5ad3d-4b2d-4683-a3cd-ffeeab387697 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:42.269267 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-efa5ad3d-4b2d-4683-a3cd-ffeeab387697 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:42.274366 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-efa5ad3d-4b2d-4683-a3cd-ffeeab387697 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:42.275014 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-efa5ad3d-4b2d-4683-a3cd-ffeeab387697 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:42.277312 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-efa5ad3d-4b2d-4683-a3cd-ffeeab387697 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:42.913323 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-efa5ad3d-4b2d-4683-a3cd-ffeeab387697 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:42.932588 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-efa5ad3d-4b2d-4683-a3cd-ffeeab387697 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1294 microversion: 2.1 time: 0.684582 Aug 24 03:30:42.943412 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 46/84] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:42 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1294 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:42.977726 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-117f4c35-9722-46e8-8bd0-2bdbe5280c1a tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:42.979336 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-117f4c35-9722-46e8-8bd0-2bdbe5280c1a tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] [instance: a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:42.999205 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-117f4c35-9722-46e8-8bd0-2bdbe5280c1a tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:42.999896 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-117f4c35-9722-46e8-8bd0-2bdbe5280c1a tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:43.000360 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-117f4c35-9722-46e8-8bd0-2bdbe5280c1a tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:43.004204 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-117f4c35-9722-46e8-8bd0-2bdbe5280c1a tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:43.004717 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-117f4c35-9722-46e8-8bd0-2bdbe5280c1a tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:43.007374 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-117f4c35-9722-46e8-8bd0-2bdbe5280c1a tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:43.429431 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=28 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:43.719270 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c78308b1-0445-4e4a-b38c-da1042770d65 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:43.738534 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c78308b1-0445-4e4a-b38c-da1042770d65 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1322 microversion: 2.1 time: 1.924722 Aug 24 03:30:43.739295 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 39/85] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:41 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1322 bytes in 1927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:43.853174 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-117f4c35-9722-46e8-8bd0-2bdbe5280c1a tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bf5ffbf2d47c9b54c4c1e343e8944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be0cbafba614105869a0913a21a127b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:43.890493 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-117f4c35-9722-46e8-8bd0-2bdbe5280c1a tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] 10.222.0.81 "GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f" status: 200 len: 1315 microversion: 2.1 time: 0.944118 Aug 24 03:30:43.907394 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 47/86] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:42 2022] GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f => generated 1315 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:43.963345 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-3e1abaf1-1c81-4599-aee9-aa3889965051 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:43.964380 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-3e1abaf1-1c81-4599-aee9-aa3889965051 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:43.972169 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3e1abaf1-1c81-4599-aee9-aa3889965051 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:43.972962 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3e1abaf1-1c81-4599-aee9-aa3889965051 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:43.974166 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3e1abaf1-1c81-4599-aee9-aa3889965051 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:43.976265 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3e1abaf1-1c81-4599-aee9-aa3889965051 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:43.977868 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3e1abaf1-1c81-4599-aee9-aa3889965051 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:43.979692 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3e1abaf1-1c81-4599-aee9-aa3889965051 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:44.090417 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-3e1abaf1-1c81-4599-aee9-aa3889965051 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:44.103488 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-3e1abaf1-1c81-4599-aee9-aa3889965051 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1294 microversion: 2.1 time: 0.145252 Aug 24 03:30:44.116927 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 40/87] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:43 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1294 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:44.764318 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-25476b87-ca07-4754-a412-4a7f0c0a9126 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:44.765946 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-25476b87-ca07-4754-a412-4a7f0c0a9126 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:44.776093 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-25476b87-ca07-4754-a412-4a7f0c0a9126 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:44.778867 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-25476b87-ca07-4754-a412-4a7f0c0a9126 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:44.780513 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-25476b87-ca07-4754-a412-4a7f0c0a9126 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:44.782719 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-25476b87-ca07-4754-a412-4a7f0c0a9126 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:44.783828 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-25476b87-ca07-4754-a412-4a7f0c0a9126 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:44.784381 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-25476b87-ca07-4754-a412-4a7f0c0a9126 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:44.920326 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-841f5ba5-b79c-4737-bc0a-0a1f4579156d tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:44.922139 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-841f5ba5-b79c-4737-bc0a-0a1f4579156d tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] [instance: a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:44.955487 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-841f5ba5-b79c-4737-bc0a-0a1f4579156d tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:44.959778 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-841f5ba5-b79c-4737-bc0a-0a1f4579156d tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:44.965499 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-841f5ba5-b79c-4737-bc0a-0a1f4579156d tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:44.967456 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-841f5ba5-b79c-4737-bc0a-0a1f4579156d tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:44.968129 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-841f5ba5-b79c-4737-bc0a-0a1f4579156d tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:44.968850 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-841f5ba5-b79c-4737-bc0a-0a1f4579156d tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:45.399501 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-25476b87-ca07-4754-a412-4a7f0c0a9126 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:45.407569 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-25476b87-ca07-4754-a412-4a7f0c0a9126 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1322 microversion: 2.1 time: 0.648244 Aug 24 03:30:45.413176 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 48/88] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:44 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1322 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:45.418819 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-698eadac-5dfe-40e0-a7a7-e44e6b0ff23b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:45.423192 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-698eadac-5dfe-40e0-a7a7-e44e6b0ff23b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:45.435518 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-698eadac-5dfe-40e0-a7a7-e44e6b0ff23b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:45.438473 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-698eadac-5dfe-40e0-a7a7-e44e6b0ff23b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:45.439679 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-698eadac-5dfe-40e0-a7a7-e44e6b0ff23b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:45.442796 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-698eadac-5dfe-40e0-a7a7-e44e6b0ff23b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:45.444194 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-698eadac-5dfe-40e0-a7a7-e44e6b0ff23b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:45.445145 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-698eadac-5dfe-40e0-a7a7-e44e6b0ff23b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:45.644666 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-698eadac-5dfe-40e0-a7a7-e44e6b0ff23b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:45.672349 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-841f5ba5-b79c-4737-bc0a-0a1f4579156d tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bf5ffbf2d47c9b54c4c1e343e8944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be0cbafba614105869a0913a21a127b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:45.684634 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-841f5ba5-b79c-4737-bc0a-0a1f4579156d tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] 10.222.0.81 "GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f" status: 200 len: 1315 microversion: 2.1 time: 0.775078 Aug 24 03:30:45.685425 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 41/89] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:44 2022] GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f => generated 1315 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:45.687768 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-698eadac-5dfe-40e0-a7a7-e44e6b0ff23b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1294 microversion: 2.1 time: 0.273252 Aug 24 03:30:45.701130 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 49/90] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:45 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1294 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:46.442034 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-852d5786-c706-4b8c-a1f6-ea9e2a0c4381 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:46.444743 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-852d5786-c706-4b8c-a1f6-ea9e2a0c4381 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:46.465351 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:46.471691 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-852d5786-c706-4b8c-a1f6-ea9e2a0c4381 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:46.473197 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-852d5786-c706-4b8c-a1f6-ea9e2a0c4381 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:46.476444 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-852d5786-c706-4b8c-a1f6-ea9e2a0c4381 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:46.481703 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-852d5786-c706-4b8c-a1f6-ea9e2a0c4381 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:46.485268 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-852d5786-c706-4b8c-a1f6-ea9e2a0c4381 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:46.487925 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-852d5786-c706-4b8c-a1f6-ea9e2a0c4381 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:46.516680 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=75 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:46.709490 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-ab32fd7a-3680-4b58-8e61-0ac6ee12439a tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:46.710830 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-ab32fd7a-3680-4b58-8e61-0ac6ee12439a tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] [instance: a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:46.730690 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ab32fd7a-3680-4b58-8e61-0ac6ee12439a tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:46.731636 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ab32fd7a-3680-4b58-8e61-0ac6ee12439a tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:46.732401 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ab32fd7a-3680-4b58-8e61-0ac6ee12439a tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:46.737789 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ab32fd7a-3680-4b58-8e61-0ac6ee12439a tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:46.738676 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ab32fd7a-3680-4b58-8e61-0ac6ee12439a tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:46.740786 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ab32fd7a-3680-4b58-8e61-0ac6ee12439a tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:47.410876 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-852d5786-c706-4b8c-a1f6-ea9e2a0c4381 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:47.433352 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-852d5786-c706-4b8c-a1f6-ea9e2a0c4381 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1322 microversion: 2.1 time: 0.997236 Aug 24 03:30:47.436345 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 42/91] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:46 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1322 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:47.444530 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d6af8440-09dd-44cc-87bf-7dbd1b150707 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:47.446017 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d6af8440-09dd-44cc-87bf-7dbd1b150707 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:47.460251 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d6af8440-09dd-44cc-87bf-7dbd1b150707 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:47.461934 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d6af8440-09dd-44cc-87bf-7dbd1b150707 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:47.462835 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d6af8440-09dd-44cc-87bf-7dbd1b150707 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:47.466662 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d6af8440-09dd-44cc-87bf-7dbd1b150707 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:47.467691 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d6af8440-09dd-44cc-87bf-7dbd1b150707 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:47.468447 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d6af8440-09dd-44cc-87bf-7dbd1b150707 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:47.816433 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d6af8440-09dd-44cc-87bf-7dbd1b150707 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:47.829327 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d6af8440-09dd-44cc-87bf-7dbd1b150707 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1294 microversion: 2.1 time: 0.391416 Aug 24 03:30:47.830509 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 43/92] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:47 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1294 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:47.883753 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-ab32fd7a-3680-4b58-8e61-0ac6ee12439a tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bf5ffbf2d47c9b54c4c1e343e8944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be0cbafba614105869a0913a21a127b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:47.897266 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-ab32fd7a-3680-4b58-8e61-0ac6ee12439a tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] 10.222.0.81 "GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f" status: 200 len: 1315 microversion: 2.1 time: 1.193060 Aug 24 03:30:47.900496 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 50/93] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:46 2022] GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f => generated 1315 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:48.466525 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-6950e943-e795-4194-ab0e-a5b89829a96b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:48.467944 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-6950e943-e795-4194-ab0e-a5b89829a96b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:48.482493 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=4 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:48.485249 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6950e943-e795-4194-ab0e-a5b89829a96b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:48.486998 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6950e943-e795-4194-ab0e-a5b89829a96b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:48.487527 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6950e943-e795-4194-ab0e-a5b89829a96b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:48.488626 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6950e943-e795-4194-ab0e-a5b89829a96b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:48.489607 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6950e943-e795-4194-ab0e-a5b89829a96b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:48.490486 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6950e943-e795-4194-ab0e-a5b89829a96b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:48.752510 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-6950e943-e795-4194-ab0e-a5b89829a96b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:48.782692 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-6950e943-e795-4194-ab0e-a5b89829a96b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1322 microversion: 2.1 time: 0.324631 Aug 24 03:30:48.788583 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 44/94] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:48 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1322 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:48.851760 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-8d7e799c-b812-48d4-9235-f7fbeb02529c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:48.852476 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-8d7e799c-b812-48d4-9235-f7fbeb02529c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:48.862142 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell0:SELECT=2 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:48.871141 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8d7e799c-b812-48d4-9235-f7fbeb02529c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:48.871756 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8d7e799c-b812-48d4-9235-f7fbeb02529c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:48.872166 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8d7e799c-b812-48d4-9235-f7fbeb02529c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:48.872948 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8d7e799c-b812-48d4-9235-f7fbeb02529c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:48.888814 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8d7e799c-b812-48d4-9235-f7fbeb02529c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:48.889375 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8d7e799c-b812-48d4-9235-f7fbeb02529c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:48.921755 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-eb97246b-1f5a-4b75-a9b7-836ab04db281 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:48.922607 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-eb97246b-1f5a-4b75-a9b7-836ab04db281 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] [instance: a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:48.934965 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eb97246b-1f5a-4b75-a9b7-836ab04db281 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:48.938751 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eb97246b-1f5a-4b75-a9b7-836ab04db281 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:48.939716 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eb97246b-1f5a-4b75-a9b7-836ab04db281 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:48.942473 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eb97246b-1f5a-4b75-a9b7-836ab04db281 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:48.945265 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eb97246b-1f5a-4b75-a9b7-836ab04db281 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:48.947175 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eb97246b-1f5a-4b75-a9b7-836ab04db281 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:49.241471 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-eb97246b-1f5a-4b75-a9b7-836ab04db281 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bf5ffbf2d47c9b54c4c1e343e8944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be0cbafba614105869a0913a21a127b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:49.253728 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-eb97246b-1f5a-4b75-a9b7-836ab04db281 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] 10.222.0.81 "GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f" status: 200 len: 1315 microversion: 2.1 time: 0.336226 Aug 24 03:30:49.254305 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 45/95] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:48 2022] GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:49.374076 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-8d7e799c-b812-48d4-9235-f7fbeb02529c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:49.389787 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-8d7e799c-b812-48d4-9235-f7fbeb02529c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1361 microversion: 2.1 time: 0.540596 Aug 24 03:30:49.391019 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 51/96] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:48 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1361 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:49.818180 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-fc9ee628-52d2-4769-9a83-9e4e8fe03a62 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:49.819602 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-fc9ee628-52d2-4769-9a83-9e4e8fe03a62 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:49.831097 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fc9ee628-52d2-4769-9a83-9e4e8fe03a62 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:49.835427 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fc9ee628-52d2-4769-9a83-9e4e8fe03a62 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:49.836069 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fc9ee628-52d2-4769-9a83-9e4e8fe03a62 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:49.837158 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fc9ee628-52d2-4769-9a83-9e4e8fe03a62 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:49.837831 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fc9ee628-52d2-4769-9a83-9e4e8fe03a62 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:49.838439 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fc9ee628-52d2-4769-9a83-9e4e8fe03a62 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:50.023282 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-fc9ee628-52d2-4769-9a83-9e4e8fe03a62 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:50.032050 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-fc9ee628-52d2-4769-9a83-9e4e8fe03a62 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1322 microversion: 2.1 time: 0.221755 Aug 24 03:30:50.032804 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 46/97] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:49 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:50.275570 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-330305c4-532d-4550-82c2-a80cf7403757 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:50.278167 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-330305c4-532d-4550-82c2-a80cf7403757 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] [instance: a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:50.285089 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-330305c4-532d-4550-82c2-a80cf7403757 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:50.285811 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-330305c4-532d-4550-82c2-a80cf7403757 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:50.286410 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-330305c4-532d-4550-82c2-a80cf7403757 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:50.287108 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-330305c4-532d-4550-82c2-a80cf7403757 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:50.287717 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-330305c4-532d-4550-82c2-a80cf7403757 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:50.288148 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-330305c4-532d-4550-82c2-a80cf7403757 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:50.416289 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-83f14051-bab8-4fbe-9bac-170066e95100 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:50.418794 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-83f14051-bab8-4fbe-9bac-170066e95100 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:50.427857 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-83f14051-bab8-4fbe-9bac-170066e95100 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:50.428548 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-83f14051-bab8-4fbe-9bac-170066e95100 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:50.429705 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-83f14051-bab8-4fbe-9bac-170066e95100 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:50.430860 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-83f14051-bab8-4fbe-9bac-170066e95100 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:50.431950 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-83f14051-bab8-4fbe-9bac-170066e95100 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:50.433924 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-83f14051-bab8-4fbe-9bac-170066e95100 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:50.468727 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-330305c4-532d-4550-82c2-a80cf7403757 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bf5ffbf2d47c9b54c4c1e343e8944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be0cbafba614105869a0913a21a127b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:50.478363 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-330305c4-532d-4550-82c2-a80cf7403757 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] 10.222.0.81 "GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f" status: 200 len: 1315 microversion: 2.1 time: 0.206880 Aug 24 03:30:50.492337 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 52/98] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:50 2022] GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:50.599257 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-83f14051-bab8-4fbe-9bac-170066e95100 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:50.607032 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-83f14051-bab8-4fbe-9bac-170066e95100 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1361 microversion: 2.1 time: 0.194979 Aug 24 03:30:50.607608 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 47/99] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:50 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1361 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:30:51.052713 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-ab465409-7dd8-45c2-8765-d8778be4e2fb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:51.053414 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-ab465409-7dd8-45c2-8765-d8778be4e2fb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:51.063776 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ab465409-7dd8-45c2-8765-d8778be4e2fb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:51.064694 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ab465409-7dd8-45c2-8765-d8778be4e2fb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:51.066467 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ab465409-7dd8-45c2-8765-d8778be4e2fb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:51.069048 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ab465409-7dd8-45c2-8765-d8778be4e2fb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:51.070064 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ab465409-7dd8-45c2-8765-d8778be4e2fb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:51.071003 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ab465409-7dd8-45c2-8765-d8778be4e2fb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:51.243290 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-ab465409-7dd8-45c2-8765-d8778be4e2fb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:51.254584 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-ab465409-7dd8-45c2-8765-d8778be4e2fb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1322 microversion: 2.1 time: 0.205662 Aug 24 03:30:51.255529 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 53/100] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:51 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:51.500975 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c7358d0a-4108-4c06-bab1-c5fbed4d62b9 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:51.501920 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c7358d0a-4108-4c06-bab1-c5fbed4d62b9 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] [instance: a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:51.508852 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c7358d0a-4108-4c06-bab1-c5fbed4d62b9 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:51.509458 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c7358d0a-4108-4c06-bab1-c5fbed4d62b9 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:51.510023 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c7358d0a-4108-4c06-bab1-c5fbed4d62b9 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:51.511396 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c7358d0a-4108-4c06-bab1-c5fbed4d62b9 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:51.512162 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c7358d0a-4108-4c06-bab1-c5fbed4d62b9 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:51.512699 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c7358d0a-4108-4c06-bab1-c5fbed4d62b9 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:51.629161 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-e3bab528-be39-4a4b-80ce-f5cf8c353564 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:51.629883 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-e3bab528-be39-4a4b-80ce-f5cf8c353564 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:51.638794 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e3bab528-be39-4a4b-80ce-f5cf8c353564 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:51.639297 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e3bab528-be39-4a4b-80ce-f5cf8c353564 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:51.642797 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e3bab528-be39-4a4b-80ce-f5cf8c353564 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:51.642797 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e3bab528-be39-4a4b-80ce-f5cf8c353564 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:51.642797 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e3bab528-be39-4a4b-80ce-f5cf8c353564 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:51.642797 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e3bab528-be39-4a4b-80ce-f5cf8c353564 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:51.665147 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c7358d0a-4108-4c06-bab1-c5fbed4d62b9 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bf5ffbf2d47c9b54c4c1e343e8944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be0cbafba614105869a0913a21a127b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:51.675574 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c7358d0a-4108-4c06-bab1-c5fbed4d62b9 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] 10.222.0.81 "GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f" status: 200 len: 1315 microversion: 2.1 time: 0.179362 Aug 24 03:30:51.676252 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 48/101] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:51 2022] GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:51.787367 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-e3bab528-be39-4a4b-80ce-f5cf8c353564 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:51.795573 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-e3bab528-be39-4a4b-80ce-f5cf8c353564 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1361 microversion: 2.1 time: 0.170985 Aug 24 03:30:51.796147 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 54/102] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:51 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:52.277201 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-76791041-9bc1-4beb-9c4c-04924b4aa2b8 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:52.277812 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-76791041-9bc1-4beb-9c4c-04924b4aa2b8 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:52.283765 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-76791041-9bc1-4beb-9c4c-04924b4aa2b8 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:52.284246 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-76791041-9bc1-4beb-9c4c-04924b4aa2b8 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:52.284676 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-76791041-9bc1-4beb-9c4c-04924b4aa2b8 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:52.285383 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-76791041-9bc1-4beb-9c4c-04924b4aa2b8 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:52.285833 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-76791041-9bc1-4beb-9c4c-04924b4aa2b8 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:52.286251 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-76791041-9bc1-4beb-9c4c-04924b4aa2b8 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:52.436604 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-76791041-9bc1-4beb-9c4c-04924b4aa2b8 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:52.446403 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-76791041-9bc1-4beb-9c4c-04924b4aa2b8 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1322 microversion: 2.1 time: 0.172048 Aug 24 03:30:52.447231 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 49/103] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:52 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:52.697030 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-fd53791d-99d5-4ca3-9e84-894e3fcef900 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:52.698299 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-fd53791d-99d5-4ca3-9e84-894e3fcef900 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] [instance: a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:52.704715 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fd53791d-99d5-4ca3-9e84-894e3fcef900 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:52.705658 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fd53791d-99d5-4ca3-9e84-894e3fcef900 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:52.707981 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fd53791d-99d5-4ca3-9e84-894e3fcef900 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:52.713385 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fd53791d-99d5-4ca3-9e84-894e3fcef900 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:52.714485 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fd53791d-99d5-4ca3-9e84-894e3fcef900 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:52.715028 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fd53791d-99d5-4ca3-9e84-894e3fcef900 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:52.817358 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2373de72-78b5-4f05-b257-bfc57550ebdb tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:52.818613 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2373de72-78b5-4f05-b257-bfc57550ebdb tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:52.830848 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2373de72-78b5-4f05-b257-bfc57550ebdb tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:52.831623 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2373de72-78b5-4f05-b257-bfc57550ebdb tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:52.834513 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2373de72-78b5-4f05-b257-bfc57550ebdb tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:52.835402 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2373de72-78b5-4f05-b257-bfc57550ebdb tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:52.837497 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2373de72-78b5-4f05-b257-bfc57550ebdb tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:52.838103 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2373de72-78b5-4f05-b257-bfc57550ebdb tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:53.041770 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-fd53791d-99d5-4ca3-9e84-894e3fcef900 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bf5ffbf2d47c9b54c4c1e343e8944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be0cbafba614105869a0913a21a127b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:53.052447 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-fd53791d-99d5-4ca3-9e84-894e3fcef900 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] 10.222.0.81 "GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f" status: 200 len: 1315 microversion: 2.1 time: 0.359196 Aug 24 03:30:53.053354 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 55/104] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:52 2022] GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:53.412169 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2373de72-78b5-4f05-b257-bfc57550ebdb tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:53.426108 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2373de72-78b5-4f05-b257-bfc57550ebdb tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1361 microversion: 2.1 time: 0.609238 Aug 24 03:30:53.427270 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 50/105] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:52 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1361 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:53.474166 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-cb890d85-ddfb-4fa2-891c-28e3a7a5afd0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:53.475528 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-cb890d85-ddfb-4fa2-891c-28e3a7a5afd0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:53.487668 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cb890d85-ddfb-4fa2-891c-28e3a7a5afd0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:53.488698 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cb890d85-ddfb-4fa2-891c-28e3a7a5afd0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:53.489163 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cb890d85-ddfb-4fa2-891c-28e3a7a5afd0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:53.489870 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cb890d85-ddfb-4fa2-891c-28e3a7a5afd0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:53.490323 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cb890d85-ddfb-4fa2-891c-28e3a7a5afd0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:53.490749 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cb890d85-ddfb-4fa2-891c-28e3a7a5afd0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:53.521543 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell1:SELECT=100 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:53.788688 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-cb890d85-ddfb-4fa2-891c-28e3a7a5afd0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:53.817693 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-cb890d85-ddfb-4fa2-891c-28e3a7a5afd0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1322 microversion: 2.1 time: 0.348324 Aug 24 03:30:53.834068 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 56/106] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:53 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1322 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:54.077106 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-41add409-4e15-4904-8df8-140e9bb4a1f0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:54.078656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-41add409-4e15-4904-8df8-140e9bb4a1f0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] [instance: a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:54.090534 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-41add409-4e15-4904-8df8-140e9bb4a1f0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:54.091123 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-41add409-4e15-4904-8df8-140e9bb4a1f0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:54.091810 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-41add409-4e15-4904-8df8-140e9bb4a1f0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:54.093430 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-41add409-4e15-4904-8df8-140e9bb4a1f0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:54.094105 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-41add409-4e15-4904-8df8-140e9bb4a1f0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:54.095276 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-41add409-4e15-4904-8df8-140e9bb4a1f0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:54.387286 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-41add409-4e15-4904-8df8-140e9bb4a1f0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bf5ffbf2d47c9b54c4c1e343e8944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be0cbafba614105869a0913a21a127b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:54.406566 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-41add409-4e15-4904-8df8-140e9bb4a1f0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] 10.222.0.81 "GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f" status: 200 len: 1315 microversion: 2.1 time: 0.336774 Aug 24 03:30:54.410433 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 51/107] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:54 2022] GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:54.449714 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-41b5b4de-ee3f-49a6-9b82-2711861b1c75 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:54.450217 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-41b5b4de-ee3f-49a6-9b82-2711861b1c75 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:54.470267 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-86b3c0c5-26a2-498a-b332-5f1ec5454a36 req-7db88a31-bccd-4673-9f87-f5e455fe7146 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b97b3d6-5022-46c8-a189-fed177d028c8", "tag": "22bcdf61-5bce-471a-ac6d-924789d218c0"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:54.478568 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-41b5b4de-ee3f-49a6-9b82-2711861b1c75 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:54.481459 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-41b5b4de-ee3f-49a6-9b82-2711861b1c75 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:54.482174 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-41b5b4de-ee3f-49a6-9b82-2711861b1c75 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:54.484929 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-41b5b4de-ee3f-49a6-9b82-2711861b1c75 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:54.487219 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-41b5b4de-ee3f-49a6-9b82-2711861b1c75 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:54.488106 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-41b5b4de-ee3f-49a6-9b82-2711861b1c75 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:54.492651 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-86b3c0c5-26a2-498a-b332-5f1ec5454a36 req-7db88a31-bccd-4673-9f87-f5e455fe7146 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:54.493440 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-86b3c0c5-26a2-498a-b332-5f1ec5454a36 req-7db88a31-bccd-4673-9f87-f5e455fe7146 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:54.494042 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-86b3c0c5-26a2-498a-b332-5f1ec5454a36 req-7db88a31-bccd-4673-9f87-f5e455fe7146 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:54.520799 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-86b3c0c5-26a2-498a-b332-5f1ec5454a36 req-7db88a31-bccd-4673-9f87-f5e455fe7146 service nova] Creating event network-changed:22bcdf61-5bce-471a-ac6d-924789d218c0 for instance 9b97b3d6-5022-46c8-a189-fed177d028c8 on hv-cinder-85426 Aug 24 03:30:54.533966 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-86b3c0c5-26a2-498a-b332-5f1ec5454a36 req-7db88a31-bccd-4673-9f87-f5e455fe7146 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068119 Aug 24 03:30:54.534738 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 52/108] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:54.857196 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-60d5139a-c5ea-4e60-ba3f-f4849fd870ee tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:54.858102 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-60d5139a-c5ea-4e60-ba3f-f4849fd870ee tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:54.880776 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-60d5139a-c5ea-4e60-ba3f-f4849fd870ee tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:54.882588 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-60d5139a-c5ea-4e60-ba3f-f4849fd870ee tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:54.883044 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-60d5139a-c5ea-4e60-ba3f-f4849fd870ee tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:54.883775 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-60d5139a-c5ea-4e60-ba3f-f4849fd870ee tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:54.884237 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-60d5139a-c5ea-4e60-ba3f-f4849fd870ee tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:54.897597 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-60d5139a-c5ea-4e60-ba3f-f4849fd870ee tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:55.082383 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-41b5b4de-ee3f-49a6-9b82-2711861b1c75 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:55.095170 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-41b5b4de-ee3f-49a6-9b82-2711861b1c75 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1361 microversion: 2.1 time: 0.650426 Aug 24 03:30:55.098213 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 57/109] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:54 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1361 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:55.236472 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-60d5139a-c5ea-4e60-ba3f-f4849fd870ee tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:55.248601 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-60d5139a-c5ea-4e60-ba3f-f4849fd870ee tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1322 microversion: 2.1 time: 0.396767 Aug 24 03:30:55.250440 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 53/110] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:54 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1322 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:30:55.436859 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-0af42e3b-0c95-4b1b-8a61-63b684c80c92 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:55.437964 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-0af42e3b-0c95-4b1b-8a61-63b684c80c92 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] [instance: a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:55.453589 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0af42e3b-0c95-4b1b-8a61-63b684c80c92 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:55.454289 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0af42e3b-0c95-4b1b-8a61-63b684c80c92 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:55.456059 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0af42e3b-0c95-4b1b-8a61-63b684c80c92 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:55.458376 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0af42e3b-0c95-4b1b-8a61-63b684c80c92 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:55.459205 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0af42e3b-0c95-4b1b-8a61-63b684c80c92 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:55.462732 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0af42e3b-0c95-4b1b-8a61-63b684c80c92 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:55.752507 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-8d04982d-a8cb-4a12-a4d9-37b0b6e9d16c req-2894c2c2-395d-46d6-86c6-d7f16c2c6ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a844487d-f9fc-4452-843d-d6ac2efb35d6", "name": "network-vif-plugged", "status": "completed", "tag": "96ac11e6-aaa8-4961-9e5b-62c81b5e9607"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:55.777960 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-8d04982d-a8cb-4a12-a4d9-37b0b6e9d16c req-2894c2c2-395d-46d6-86c6-d7f16c2c6ec1 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:55.778406 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-8d04982d-a8cb-4a12-a4d9-37b0b6e9d16c req-2894c2c2-395d-46d6-86c6-d7f16c2c6ec1 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:55.778984 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-8d04982d-a8cb-4a12-a4d9-37b0b6e9d16c req-2894c2c2-395d-46d6-86c6-d7f16c2c6ec1 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:55.793468 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-8d04982d-a8cb-4a12-a4d9-37b0b6e9d16c req-2894c2c2-395d-46d6-86c6-d7f16c2c6ec1 service nova] Creating event network-vif-plugged:96ac11e6-aaa8-4961-9e5b-62c81b5e9607 for instance a844487d-f9fc-4452-843d-d6ac2efb35d6 on hv-cinder-85426 Aug 24 03:30:55.799588 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-8d04982d-a8cb-4a12-a4d9-37b0b6e9d16c req-2894c2c2-395d-46d6-86c6-d7f16c2c6ec1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168683 Aug 24 03:30:55.801497 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 54/111] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:55.976593 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-0af42e3b-0c95-4b1b-8a61-63b684c80c92 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bf5ffbf2d47c9b54c4c1e343e8944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be0cbafba614105869a0913a21a127b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:55.986764 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-0af42e3b-0c95-4b1b-8a61-63b684c80c92 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] 10.222.0.81 "GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f" status: 200 len: 1315 microversion: 2.1 time: 0.555059 Aug 24 03:30:55.994506 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 58/112] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:55 2022] GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f => generated 1315 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:56.119085 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-201dd880-f77f-4896-b722-b4da57819308 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:56.119783 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-201dd880-f77f-4896-b722-b4da57819308 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:56.131823 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-201dd880-f77f-4896-b722-b4da57819308 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:56.132327 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-201dd880-f77f-4896-b722-b4da57819308 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:56.132784 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-201dd880-f77f-4896-b722-b4da57819308 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:56.133495 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-201dd880-f77f-4896-b722-b4da57819308 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:56.133946 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-201dd880-f77f-4896-b722-b4da57819308 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:56.134452 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-201dd880-f77f-4896-b722-b4da57819308 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:56.274664 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-0ac9afe0-dff9-4ca0-bc76-a4880dca7c53 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:56.275341 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-0ac9afe0-dff9-4ca0-bc76-a4880dca7c53 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:56.285827 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0ac9afe0-dff9-4ca0-bc76-a4880dca7c53 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:56.286343 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0ac9afe0-dff9-4ca0-bc76-a4880dca7c53 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:56.286780 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0ac9afe0-dff9-4ca0-bc76-a4880dca7c53 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:56.294845 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0ac9afe0-dff9-4ca0-bc76-a4880dca7c53 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:56.295113 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0ac9afe0-dff9-4ca0-bc76-a4880dca7c53 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:56.295593 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0ac9afe0-dff9-4ca0-bc76-a4880dca7c53 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:56.453341 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-201dd880-f77f-4896-b722-b4da57819308 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:56.471688 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-201dd880-f77f-4896-b722-b4da57819308 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1361 microversion: 2.1 time: 0.355126 Aug 24 03:30:56.472201 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 55/113] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:56 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1361 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:56.528659 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-0ac9afe0-dff9-4ca0-bc76-a4880dca7c53 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:56.537816 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-0ac9afe0-dff9-4ca0-bc76-a4880dca7c53 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1322 microversion: 2.1 time: 0.267841 Aug 24 03:30:56.538992 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 59/114] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:56 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1322 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:57.015020 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-eac0be81-24f8-4aa2-8bd0-231f43a8269d tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:57.015639 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-eac0be81-24f8-4aa2-8bd0-231f43a8269d tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] [instance: a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:57.032253 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eac0be81-24f8-4aa2-8bd0-231f43a8269d tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:57.033104 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eac0be81-24f8-4aa2-8bd0-231f43a8269d tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:57.033774 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eac0be81-24f8-4aa2-8bd0-231f43a8269d tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:57.034685 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eac0be81-24f8-4aa2-8bd0-231f43a8269d tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:57.036516 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eac0be81-24f8-4aa2-8bd0-231f43a8269d tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:57.039031 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eac0be81-24f8-4aa2-8bd0-231f43a8269d tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:57.332928 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-eac0be81-24f8-4aa2-8bd0-231f43a8269d tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bf5ffbf2d47c9b54c4c1e343e8944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be0cbafba614105869a0913a21a127b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:57.370000 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-eac0be81-24f8-4aa2-8bd0-231f43a8269d tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] 10.222.0.81 "GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f" status: 200 len: 1315 microversion: 2.1 time: 0.359856 Aug 24 03:30:57.377950 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 56/115] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:57 2022] GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:57.493435 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-3d10f779-3984-414d-aca2-0377f1d49eb6 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:57.494047 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-3d10f779-3984-414d-aca2-0377f1d49eb6 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:57.519720 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3d10f779-3984-414d-aca2-0377f1d49eb6 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:57.520611 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3d10f779-3984-414d-aca2-0377f1d49eb6 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:57.521952 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3d10f779-3984-414d-aca2-0377f1d49eb6 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:57.522883 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3d10f779-3984-414d-aca2-0377f1d49eb6 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:57.523886 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3d10f779-3984-414d-aca2-0377f1d49eb6 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:57.524473 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3d10f779-3984-414d-aca2-0377f1d49eb6 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:57.562843 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f77a07fe-fce5-46d2-a25c-0df1005093a3 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:57.563693 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f77a07fe-fce5-46d2-a25c-0df1005093a3 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:57.577825 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f77a07fe-fce5-46d2-a25c-0df1005093a3 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:57.578691 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f77a07fe-fce5-46d2-a25c-0df1005093a3 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:57.579288 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f77a07fe-fce5-46d2-a25c-0df1005093a3 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:57.580399 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f77a07fe-fce5-46d2-a25c-0df1005093a3 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:57.581098 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f77a07fe-fce5-46d2-a25c-0df1005093a3 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:57.581904 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f77a07fe-fce5-46d2-a25c-0df1005093a3 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:57.801121 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-3d10f779-3984-414d-aca2-0377f1d49eb6 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:57.808534 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-3d10f779-3984-414d-aca2-0377f1d49eb6 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1361 microversion: 2.1 time: 0.319319 Aug 24 03:30:57.815196 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f77a07fe-fce5-46d2-a25c-0df1005093a3 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:57.821560 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 60/116] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:57 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1361 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:57.828695 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-8bdd0b8f-ee93-4694-b20a-b8a0e17d4a7d req-bb10f899-148a-42d6-b596-586db168a988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f", "name": "network-vif-plugged", "status": "completed", "tag": "045cb674-6952-47d7-bb5e-17ac22a1ef2e"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:57.832781 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f77a07fe-fce5-46d2-a25c-0df1005093a3 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1322 microversion: 2.1 time: 0.276444 Aug 24 03:30:57.834394 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 57/117] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:57 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:57.853308 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-8bdd0b8f-ee93-4694-b20a-b8a0e17d4a7d req-bb10f899-148a-42d6-b596-586db168a988 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:57.854262 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-8bdd0b8f-ee93-4694-b20a-b8a0e17d4a7d req-bb10f899-148a-42d6-b596-586db168a988 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:57.855160 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-8bdd0b8f-ee93-4694-b20a-b8a0e17d4a7d req-bb10f899-148a-42d6-b596-586db168a988 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:57.867953 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-8bdd0b8f-ee93-4694-b20a-b8a0e17d4a7d req-bb10f899-148a-42d6-b596-586db168a988 service nova] Creating event network-vif-plugged:045cb674-6952-47d7-bb5e-17ac22a1ef2e for instance a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f on hv-cinder-85426 Aug 24 03:30:57.873809 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-8bdd0b8f-ee93-4694-b20a-b8a0e17d4a7d req-bb10f899-148a-42d6-b596-586db168a988 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050641 Aug 24 03:30:57.874497 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 61/118] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:30:58.402788 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-e7c3208a-7e4e-4d3f-b1ba-99924d9247aa tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:58.403638 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-e7c3208a-7e4e-4d3f-b1ba-99924d9247aa tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] [instance: a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:58.410446 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e7c3208a-7e4e-4d3f-b1ba-99924d9247aa tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:58.415808 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e7c3208a-7e4e-4d3f-b1ba-99924d9247aa tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:58.416230 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e7c3208a-7e4e-4d3f-b1ba-99924d9247aa tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:58.417008 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e7c3208a-7e4e-4d3f-b1ba-99924d9247aa tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:58.420145 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e7c3208a-7e4e-4d3f-b1ba-99924d9247aa tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:58.422348 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e7c3208a-7e4e-4d3f-b1ba-99924d9247aa tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:58.738909 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-e7c3208a-7e4e-4d3f-b1ba-99924d9247aa tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bf5ffbf2d47c9b54c4c1e343e8944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be0cbafba614105869a0913a21a127b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:58.749680 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-e7c3208a-7e4e-4d3f-b1ba-99924d9247aa tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] 10.222.0.81 "GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f" status: 200 len: 1315 microversion: 2.1 time: 0.352804 Aug 24 03:30:58.750849 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 58/119] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:58 2022] GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:58.833914 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-e44cf7c8-a9fd-4e9d-bf83-3e71ab7bc12e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:58.834617 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-e44cf7c8-a9fd-4e9d-bf83-3e71ab7bc12e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:58.847388 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e44cf7c8-a9fd-4e9d-bf83-3e71ab7bc12e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:58.850328 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e44cf7c8-a9fd-4e9d-bf83-3e71ab7bc12e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:58.850766 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e44cf7c8-a9fd-4e9d-bf83-3e71ab7bc12e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:58.851539 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e44cf7c8-a9fd-4e9d-bf83-3e71ab7bc12e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:58.856037 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e44cf7c8-a9fd-4e9d-bf83-3e71ab7bc12e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:58.856553 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e44cf7c8-a9fd-4e9d-bf83-3e71ab7bc12e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:58.857068 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7bf35c4e-c42e-4d6d-bf8f-76a79b1ce1ae tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:58.858344 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-7bf35c4e-c42e-4d6d-bf8f-76a79b1ce1ae tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:58.878496 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7bf35c4e-c42e-4d6d-bf8f-76a79b1ce1ae tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:58.879022 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7bf35c4e-c42e-4d6d-bf8f-76a79b1ce1ae tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:58.879467 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7bf35c4e-c42e-4d6d-bf8f-76a79b1ce1ae tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:58.884450 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7bf35c4e-c42e-4d6d-bf8f-76a79b1ce1ae tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:58.885021 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7bf35c4e-c42e-4d6d-bf8f-76a79b1ce1ae tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:58.889688 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7bf35c4e-c42e-4d6d-bf8f-76a79b1ce1ae tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:59.213817 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-e44cf7c8-a9fd-4e9d-bf83-3e71ab7bc12e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:59.240258 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-e44cf7c8-a9fd-4e9d-bf83-3e71ab7bc12e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1361 microversion: 2.1 time: 0.410945 Aug 24 03:30:59.240926 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 62/120] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:58 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1361 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:30:59.248753 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-7bf35c4e-c42e-4d6d-bf8f-76a79b1ce1ae tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:59.262358 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-7bf35c4e-c42e-4d6d-bf8f-76a79b1ce1ae tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1322 microversion: 2.1 time: 0.411288 Aug 24 03:30:59.265772 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 59/121] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:58 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1322 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:30:59.772522 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-9e0a6853-fd69-4e26-a71e-4c421dbd6c21 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:30:59.773166 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-9e0a6853-fd69-4e26-a71e-4c421dbd6c21 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] [instance: a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:30:59.782361 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9e0a6853-fd69-4e26-a71e-4c421dbd6c21 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:59.782859 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9e0a6853-fd69-4e26-a71e-4c421dbd6c21 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:59.783295 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9e0a6853-fd69-4e26-a71e-4c421dbd6c21 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:59.789053 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9e0a6853-fd69-4e26-a71e-4c421dbd6c21 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:59.789627 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9e0a6853-fd69-4e26-a71e-4c421dbd6c21 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:59.790071 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9e0a6853-fd69-4e26-a71e-4c421dbd6c21 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:59.894864 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-17c49451-6a86-41ca-ae48-19cc9ba70cbd req-6b6908e6-ae48-4936-b9bd-2c2851ea43eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fb4b6a3-5be8-48da-a564-3bf08b732fa5", "name": "network-vif-plugged", "status": "completed", "tag": "75859805-bde6-4c9f-97a2-f33dca1a8545"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:30:59.917030 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-17c49451-6a86-41ca-ae48-19cc9ba70cbd req-6b6908e6-ae48-4936-b9bd-2c2851ea43eb service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:30:59.917903 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-17c49451-6a86-41ca-ae48-19cc9ba70cbd req-6b6908e6-ae48-4936-b9bd-2c2851ea43eb service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:30:59.919427 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-17c49451-6a86-41ca-ae48-19cc9ba70cbd req-6b6908e6-ae48-4936-b9bd-2c2851ea43eb service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:30:59.926192 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=100 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:59.937764 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-17c49451-6a86-41ca-ae48-19cc9ba70cbd req-6b6908e6-ae48-4936-b9bd-2c2851ea43eb service nova] Creating event network-vif-plugged:75859805-bde6-4c9f-97a2-f33dca1a8545 for instance 6fb4b6a3-5be8-48da-a564-3bf08b732fa5 on hv-cinder-85426 Aug 24 03:30:59.944557 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-17c49451-6a86-41ca-ae48-19cc9ba70cbd req-6b6908e6-ae48-4936-b9bd-2c2851ea43eb service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053653 Aug 24 03:30:59.945483 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 60/122] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:30:59.985614 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-9e0a6853-fd69-4e26-a71e-4c421dbd6c21 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bf5ffbf2d47c9b54c4c1e343e8944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be0cbafba614105869a0913a21a127b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:30:59.996713 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-9e0a6853-fd69-4e26-a71e-4c421dbd6c21 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] 10.222.0.81 "GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f" status: 200 len: 1315 microversion: 2.1 time: 0.228922 Aug 24 03:30:59.997326 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 63/123] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:30:59 2022] GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:00.266469 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4082184b-ff72-4a20-b613-fdbf7fedbfa9 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:00.267545 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-4082184b-ff72-4a20-b613-fdbf7fedbfa9 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:00.276052 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4082184b-ff72-4a20-b613-fdbf7fedbfa9 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:00.277810 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4082184b-ff72-4a20-b613-fdbf7fedbfa9 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:00.278477 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4082184b-ff72-4a20-b613-fdbf7fedbfa9 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:00.280034 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4082184b-ff72-4a20-b613-fdbf7fedbfa9 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:00.280851 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4082184b-ff72-4a20-b613-fdbf7fedbfa9 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:00.281522 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4082184b-ff72-4a20-b613-fdbf7fedbfa9 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:00.292051 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-a721a76d-986d-4a4d-a072-2987322ac250 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:00.293780 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-a721a76d-986d-4a4d-a072-2987322ac250 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:00.307447 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a721a76d-986d-4a4d-a072-2987322ac250 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:00.309361 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a721a76d-986d-4a4d-a072-2987322ac250 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:00.309890 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a721a76d-986d-4a4d-a072-2987322ac250 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:00.311164 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a721a76d-986d-4a4d-a072-2987322ac250 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:00.311699 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a721a76d-986d-4a4d-a072-2987322ac250 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:00.312218 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a721a76d-986d-4a4d-a072-2987322ac250 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:00.578072 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4082184b-ff72-4a20-b613-fdbf7fedbfa9 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:00.587157 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4082184b-ff72-4a20-b613-fdbf7fedbfa9 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1361 microversion: 2.1 time: 0.327299 Aug 24 03:31:00.590917 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 61/124] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:00 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1361 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:00.626466 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-a721a76d-986d-4a4d-a072-2987322ac250 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:00.635442 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-a721a76d-986d-4a4d-a072-2987322ac250 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1322 microversion: 2.1 time: 0.349609 Aug 24 03:31:00.637410 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 64/125] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:00 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1322 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:01.018556 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7be2d950-84c0-42d1-8b5b-486dcd9493d6 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:01.019933 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-7be2d950-84c0-42d1-8b5b-486dcd9493d6 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] [instance: a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:01.030725 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7be2d950-84c0-42d1-8b5b-486dcd9493d6 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:01.032337 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7be2d950-84c0-42d1-8b5b-486dcd9493d6 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:01.033029 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7be2d950-84c0-42d1-8b5b-486dcd9493d6 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:01.034229 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7be2d950-84c0-42d1-8b5b-486dcd9493d6 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:01.034901 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7be2d950-84c0-42d1-8b5b-486dcd9493d6 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:01.035760 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7be2d950-84c0-42d1-8b5b-486dcd9493d6 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:01.219591 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-7be2d950-84c0-42d1-8b5b-486dcd9493d6 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bf5ffbf2d47c9b54c4c1e343e8944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be0cbafba614105869a0913a21a127b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:01.231151 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-7be2d950-84c0-42d1-8b5b-486dcd9493d6 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] 10.222.0.81 "GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f" status: 200 len: 1502 microversion: 2.1 time: 0.214940 Aug 24 03:31:01.234081 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 62/126] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:01 2022] GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f => generated 1502 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:01.615040 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-435d1d56-8acf-4c9e-bac2-d5d927cc1dac tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:01.615722 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-435d1d56-8acf-4c9e-bac2-d5d927cc1dac tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:01.628260 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-435d1d56-8acf-4c9e-bac2-d5d927cc1dac tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:01.628611 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-435d1d56-8acf-4c9e-bac2-d5d927cc1dac tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:01.629494 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-435d1d56-8acf-4c9e-bac2-d5d927cc1dac tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:01.633455 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-435d1d56-8acf-4c9e-bac2-d5d927cc1dac tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:01.634095 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-435d1d56-8acf-4c9e-bac2-d5d927cc1dac tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:01.634892 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-435d1d56-8acf-4c9e-bac2-d5d927cc1dac tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:01.658827 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0e70cee0-61e5-4b8f-9415-be9a97e5b8e6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:01.659482 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0e70cee0-61e5-4b8f-9415-be9a97e5b8e6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:01.669770 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0e70cee0-61e5-4b8f-9415-be9a97e5b8e6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:01.670276 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0e70cee0-61e5-4b8f-9415-be9a97e5b8e6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:01.670717 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0e70cee0-61e5-4b8f-9415-be9a97e5b8e6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:01.674776 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0e70cee0-61e5-4b8f-9415-be9a97e5b8e6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:01.681415 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0e70cee0-61e5-4b8f-9415-be9a97e5b8e6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:01.683837 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0e70cee0-61e5-4b8f-9415-be9a97e5b8e6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:01.978492 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-435d1d56-8acf-4c9e-bac2-d5d927cc1dac tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:02.012638 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-435d1d56-8acf-4c9e-bac2-d5d927cc1dac tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1361 microversion: 2.1 time: 0.402116 Aug 24 03:31:02.014455 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 65/127] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:01 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1361 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:02.031001 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-0ab582a7-aff9-4ff7-95bd-ac3e028d2564 req-aaceb7a4-bf86-4cc3-8785-71b14d592d53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b97b3d6-5022-46c8-a189-fed177d028c8", "name": "network-vif-plugged", "status": "completed", "tag": "22bcdf61-5bce-471a-ac6d-924789d218c0"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:02.033798 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0e70cee0-61e5-4b8f-9415-be9a97e5b8e6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:02.043823 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0e70cee0-61e5-4b8f-9415-be9a97e5b8e6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1322 microversion: 2.1 time: 0.389174 Aug 24 03:31:02.053120 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 63/128] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:01 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1322 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:31:02.064783 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-0ab582a7-aff9-4ff7-95bd-ac3e028d2564 req-aaceb7a4-bf86-4cc3-8785-71b14d592d53 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:02.065642 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-0ab582a7-aff9-4ff7-95bd-ac3e028d2564 req-aaceb7a4-bf86-4cc3-8785-71b14d592d53 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:02.066347 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-0ab582a7-aff9-4ff7-95bd-ac3e028d2564 req-aaceb7a4-bf86-4cc3-8785-71b14d592d53 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:02.087318 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-0ab582a7-aff9-4ff7-95bd-ac3e028d2564 req-aaceb7a4-bf86-4cc3-8785-71b14d592d53 service nova] Creating event network-vif-plugged:22bcdf61-5bce-471a-ac6d-924789d218c0 for instance 9b97b3d6-5022-46c8-a189-fed177d028c8 on hv-cinder-85426 Aug 24 03:31:02.094657 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-0ab582a7-aff9-4ff7-95bd-ac3e028d2564 req-aaceb7a4-bf86-4cc3-8785-71b14d592d53 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078312 Aug 24 03:31:02.095242 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 66/129] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:03.045420 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a0db6d73-c157-4323-ad90-770d3154b51d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:03.047422 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a0db6d73-c157-4323-ad90-770d3154b51d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:03.056398 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a0db6d73-c157-4323-ad90-770d3154b51d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:03.057744 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a0db6d73-c157-4323-ad90-770d3154b51d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:03.058874 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a0db6d73-c157-4323-ad90-770d3154b51d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:03.062006 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a0db6d73-c157-4323-ad90-770d3154b51d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:03.062817 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a0db6d73-c157-4323-ad90-770d3154b51d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:03.063443 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a0db6d73-c157-4323-ad90-770d3154b51d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:03.067539 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-286b0fce-b85b-4bf5-84b6-2f208c262d55 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:03.068150 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-286b0fce-b85b-4bf5-84b6-2f208c262d55 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:03.078136 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-286b0fce-b85b-4bf5-84b6-2f208c262d55 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:03.081031 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-286b0fce-b85b-4bf5-84b6-2f208c262d55 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:03.081930 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-286b0fce-b85b-4bf5-84b6-2f208c262d55 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:03.085602 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-286b0fce-b85b-4bf5-84b6-2f208c262d55 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:03.086242 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-286b0fce-b85b-4bf5-84b6-2f208c262d55 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:03.086831 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-286b0fce-b85b-4bf5-84b6-2f208c262d55 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:03.398678 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a0db6d73-c157-4323-ad90-770d3154b51d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:03.407339 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a0db6d73-c157-4323-ad90-770d3154b51d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1361 microversion: 2.1 time: 0.367666 Aug 24 03:31:03.421717 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 64/130] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:03 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1361 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:03.433037 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c3239b75-e4cb-466c-9a3b-3271b544a9b6 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96454bd1-0fc7-46bd-a575-efe7919f5c4e"}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:03.438536 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c3239b75-e4cb-466c-9a3b-3271b544a9b6 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] [instance: a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:03.444703 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-286b0fce-b85b-4bf5-84b6-2f208c262d55 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:03.454426 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c3239b75-e4cb-466c-9a3b-3271b544a9b6 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:03.455765 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c3239b75-e4cb-466c-9a3b-3271b544a9b6 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:03.456602 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c3239b75-e4cb-466c-9a3b-3271b544a9b6 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:03.457553 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c3239b75-e4cb-466c-9a3b-3271b544a9b6 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:03.458214 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c3239b75-e4cb-466c-9a3b-3271b544a9b6 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:03.458980 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c3239b75-e4cb-466c-9a3b-3271b544a9b6 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:03.471077 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-286b0fce-b85b-4bf5-84b6-2f208c262d55 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1517 microversion: 2.1 time: 0.405232 Aug 24 03:31:03.472971 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 67/131] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:03 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1517 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:03.498197 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-ca76da4e-8c71-4486-bd87-763799a5b541 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:03.500983 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-ca76da4e-8c71-4486-bd87-763799a5b541 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:03.509021 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ca76da4e-8c71-4486-bd87-763799a5b541 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:03.509698 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ca76da4e-8c71-4486-bd87-763799a5b541 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:03.510247 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ca76da4e-8c71-4486-bd87-763799a5b541 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:03.511271 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ca76da4e-8c71-4486-bd87-763799a5b541 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:03.513193 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ca76da4e-8c71-4486-bd87-763799a5b541 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:03.513738 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ca76da4e-8c71-4486-bd87-763799a5b541 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:03.598457 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.objects.instance [None req-ca76da4e-8c71-4486-bd87-763799a5b541 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lazy-loading 'flavor' on Instance uuid 6fb4b6a3-5be8-48da-a564-3bf08b732fa5 {{(pid=120709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:31:03.739431 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-ca76da4e-8c71-4486-bd87-763799a5b541 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "POST /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5/action" status: 200 len: 32 microversion: 2.1 time: 0.245810 Aug 24 03:31:03.740898 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 68/132] 10.222.0.81 () {60 vars in 1278 bytes} [Wed Aug 24 03:31:03 2022] POST /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5/action => generated 32 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 03:31:03.751525 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-aa93a3ad-a364-4cd2-860f-d2513b874eeb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:03.752348 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-aa93a3ad-a364-4cd2-860f-d2513b874eeb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:03.760787 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-aa93a3ad-a364-4cd2-860f-d2513b874eeb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:03.760787 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-aa93a3ad-a364-4cd2-860f-d2513b874eeb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:03.761150 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-aa93a3ad-a364-4cd2-860f-d2513b874eeb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:03.762730 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-aa93a3ad-a364-4cd2-860f-d2513b874eeb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:03.763359 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-aa93a3ad-a364-4cd2-860f-d2513b874eeb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:03.764041 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-aa93a3ad-a364-4cd2-860f-d2513b874eeb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:04.002837 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-aa93a3ad-a364-4cd2-860f-d2513b874eeb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:04.016226 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-aa93a3ad-a364-4cd2-860f-d2513b874eeb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1523 microversion: 2.1 time: 0.265501 Aug 24 03:31:04.016226 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 69/133] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:03 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1523 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:31:04.208211 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c3239b75-e4cb-466c-9a3b-3271b544a9b6 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] 10.222.0.81 "POST /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.784675 Aug 24 03:31:04.209645 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 65/134] 10.222.0.81 () {60 vars in 1323 bytes} [Wed Aug 24 03:31:03 2022] POST /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f/os-volume_attachments => generated 194 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:04.428060 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-4eee556d-3acb-40ad-8f0e-7cc1848f50f7 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:04.428682 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-4eee556d-3acb-40ad-8f0e-7cc1848f50f7 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:04.435613 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4eee556d-3acb-40ad-8f0e-7cc1848f50f7 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:04.436124 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4eee556d-3acb-40ad-8f0e-7cc1848f50f7 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:04.436544 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4eee556d-3acb-40ad-8f0e-7cc1848f50f7 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:04.437271 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4eee556d-3acb-40ad-8f0e-7cc1848f50f7 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:04.438215 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4eee556d-3acb-40ad-8f0e-7cc1848f50f7 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:04.443831 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4eee556d-3acb-40ad-8f0e-7cc1848f50f7 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:04.637325 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-4eee556d-3acb-40ad-8f0e-7cc1848f50f7 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:04.646093 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-4eee556d-3acb-40ad-8f0e-7cc1848f50f7 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1361 microversion: 2.1 time: 0.221622 Aug 24 03:31:04.646880 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 70/135] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:04 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1361 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:05.041023 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f0042901-04ad-4630-a4b1-59932ca6d95b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:05.042257 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f0042901-04ad-4630-a4b1-59932ca6d95b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:05.052261 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f0042901-04ad-4630-a4b1-59932ca6d95b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:05.053282 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f0042901-04ad-4630-a4b1-59932ca6d95b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:05.054457 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f0042901-04ad-4630-a4b1-59932ca6d95b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:05.056678 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f0042901-04ad-4630-a4b1-59932ca6d95b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:05.057563 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f0042901-04ad-4630-a4b1-59932ca6d95b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:05.058973 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f0042901-04ad-4630-a4b1-59932ca6d95b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:05.261703 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f0042901-04ad-4630-a4b1-59932ca6d95b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:05.270557 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f0042901-04ad-4630-a4b1-59932ca6d95b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1523 microversion: 2.1 time: 0.239061 Aug 24 03:31:05.271774 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 66/136] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:05 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1523 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:05.669637 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-cff75394-abfe-4430-ae29-7293d66086fa tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:05.670239 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-cff75394-abfe-4430-ae29-7293d66086fa tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:05.681678 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cff75394-abfe-4430-ae29-7293d66086fa tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:05.682424 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cff75394-abfe-4430-ae29-7293d66086fa tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:05.682819 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cff75394-abfe-4430-ae29-7293d66086fa tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:05.683643 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cff75394-abfe-4430-ae29-7293d66086fa tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:05.684099 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cff75394-abfe-4430-ae29-7293d66086fa tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:05.684548 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cff75394-abfe-4430-ae29-7293d66086fa tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:05.834039 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-cff75394-abfe-4430-ae29-7293d66086fa tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:05.845977 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-cff75394-abfe-4430-ae29-7293d66086fa tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1548 microversion: 2.1 time: 0.181178 Aug 24 03:31:05.847628 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 71/137] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:05 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1548 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:05.867329 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d4521fdd-6032-4722-ae14-357ef331dc65 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:05.868118 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d4521fdd-6032-4722-ae14-357ef331dc65 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:05.876291 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d4521fdd-6032-4722-ae14-357ef331dc65 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:05.876997 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d4521fdd-6032-4722-ae14-357ef331dc65 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:05.877673 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d4521fdd-6032-4722-ae14-357ef331dc65 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:05.878674 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d4521fdd-6032-4722-ae14-357ef331dc65 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:05.879167 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d4521fdd-6032-4722-ae14-357ef331dc65 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:05.879788 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d4521fdd-6032-4722-ae14-357ef331dc65 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:05.970880 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d4521fdd-6032-4722-ae14-357ef331dc65 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107445 Aug 24 03:31:05.971920 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 67/138] 10.222.0.81 () {58 vars in 1275 bytes} [Wed Aug 24 03:31:05 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:06.298045 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-65b87a5c-a335-41c5-9960-f32825c89481 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:06.298886 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-65b87a5c-a335-41c5-9960-f32825c89481 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:06.306208 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-65b87a5c-a335-41c5-9960-f32825c89481 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:06.307174 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-65b87a5c-a335-41c5-9960-f32825c89481 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:06.307699 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-65b87a5c-a335-41c5-9960-f32825c89481 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:06.309398 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-65b87a5c-a335-41c5-9960-f32825c89481 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:06.310445 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-65b87a5c-a335-41c5-9960-f32825c89481 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:06.311095 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-65b87a5c-a335-41c5-9960-f32825c89481 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:06.331812 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:06.744085 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-65b87a5c-a335-41c5-9960-f32825c89481 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:06.754826 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-65b87a5c-a335-41c5-9960-f32825c89481 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1523 microversion: 2.1 time: 0.461109 Aug 24 03:31:06.768868 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 72/139] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:06 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1523 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:07.776667 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4accad77-2d36-464c-be46-ed40453956b4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:07.778612 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-4accad77-2d36-464c-be46-ed40453956b4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:07.793324 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4accad77-2d36-464c-be46-ed40453956b4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:07.795550 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4accad77-2d36-464c-be46-ed40453956b4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:07.796254 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4accad77-2d36-464c-be46-ed40453956b4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:07.800753 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4accad77-2d36-464c-be46-ed40453956b4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:07.803086 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4accad77-2d36-464c-be46-ed40453956b4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:07.803675 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4accad77-2d36-464c-be46-ed40453956b4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:07.930428 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-c2852b1a-80ff-49c5-b8ab-89ccbe115dc4 req-760e82f0-de04-4996-b296-50646d970ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b97b3d6-5022-46c8-a189-fed177d028c8", "tag": "22bcdf61-5bce-471a-ac6d-924789d218c0"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:07.940940 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_api:SELECT=68 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:07.944178 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-c2852b1a-80ff-49c5-b8ab-89ccbe115dc4 req-760e82f0-de04-4996-b296-50646d970ed0 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:07.944846 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-c2852b1a-80ff-49c5-b8ab-89ccbe115dc4 req-760e82f0-de04-4996-b296-50646d970ed0 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:07.945420 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-c2852b1a-80ff-49c5-b8ab-89ccbe115dc4 req-760e82f0-de04-4996-b296-50646d970ed0 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:07.960576 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-c2852b1a-80ff-49c5-b8ab-89ccbe115dc4 req-760e82f0-de04-4996-b296-50646d970ed0 service nova] Creating event network-changed:22bcdf61-5bce-471a-ac6d-924789d218c0 for instance 9b97b3d6-5022-46c8-a189-fed177d028c8 on hv-cinder-85426 Aug 24 03:31:07.967803 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-c2852b1a-80ff-49c5-b8ab-89ccbe115dc4 req-760e82f0-de04-4996-b296-50646d970ed0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041744 Aug 24 03:31:07.972850 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 73/140] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:31:08.275695 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4accad77-2d36-464c-be46-ed40453956b4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:08.292394 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4accad77-2d36-464c-be46-ed40453956b4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1523 microversion: 2.1 time: 0.519197 Aug 24 03:31:08.317070 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 68/141] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:07 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1523 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:09.325004 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-f3f97063-cb4d-4359-b9ea-fc44195f22c0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:09.326177 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-f3f97063-cb4d-4359-b9ea-fc44195f22c0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:09.334253 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f3f97063-cb4d-4359-b9ea-fc44195f22c0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:09.334832 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f3f97063-cb4d-4359-b9ea-fc44195f22c0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:09.335326 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f3f97063-cb4d-4359-b9ea-fc44195f22c0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:09.336113 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f3f97063-cb4d-4359-b9ea-fc44195f22c0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:09.336626 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f3f97063-cb4d-4359-b9ea-fc44195f22c0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:09.337156 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f3f97063-cb4d-4359-b9ea-fc44195f22c0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:09.591785 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-f3f97063-cb4d-4359-b9ea-fc44195f22c0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:09.604642 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-f3f97063-cb4d-4359-b9ea-fc44195f22c0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1523 microversion: 2.1 time: 0.283926 Aug 24 03:31:09.614738 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 74/142] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:09 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1523 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:10.631957 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-fdd3ebc1-d22b-4cf6-a8d9-afddc1c4a1b7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:10.633528 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-fdd3ebc1-d22b-4cf6-a8d9-afddc1c4a1b7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:10.642998 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fdd3ebc1-d22b-4cf6-a8d9-afddc1c4a1b7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:10.644074 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fdd3ebc1-d22b-4cf6-a8d9-afddc1c4a1b7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:10.644625 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fdd3ebc1-d22b-4cf6-a8d9-afddc1c4a1b7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:10.645525 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fdd3ebc1-d22b-4cf6-a8d9-afddc1c4a1b7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:10.646258 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fdd3ebc1-d22b-4cf6-a8d9-afddc1c4a1b7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:10.646808 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fdd3ebc1-d22b-4cf6-a8d9-afddc1c4a1b7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:10.801089 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-fdd3ebc1-d22b-4cf6-a8d9-afddc1c4a1b7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:10.809579 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-fdd3ebc1-d22b-4cf6-a8d9-afddc1c4a1b7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1523 microversion: 2.1 time: 0.184018 Aug 24 03:31:10.810156 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 69/143] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:10 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:31:11.831677 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-3de76c12-2086-4c32-aabf-2d37e5dc8ce8 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:11.835091 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-3de76c12-2086-4c32-aabf-2d37e5dc8ce8 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:11.844607 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3de76c12-2086-4c32-aabf-2d37e5dc8ce8 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:11.845445 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3de76c12-2086-4c32-aabf-2d37e5dc8ce8 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:11.846066 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3de76c12-2086-4c32-aabf-2d37e5dc8ce8 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:11.847291 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3de76c12-2086-4c32-aabf-2d37e5dc8ce8 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:11.848591 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3de76c12-2086-4c32-aabf-2d37e5dc8ce8 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:11.849217 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3de76c12-2086-4c32-aabf-2d37e5dc8ce8 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:12.079185 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-3de76c12-2086-4c32-aabf-2d37e5dc8ce8 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:12.087698 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-3de76c12-2086-4c32-aabf-2d37e5dc8ce8 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1523 microversion: 2.1 time: 0.260340 Aug 24 03:31:12.088477 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 75/144] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:11 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1523 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:13.111054 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-57f78659-5d12-43f9-80ef-8767e49387ce tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:13.111687 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-57f78659-5d12-43f9-80ef-8767e49387ce tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:13.119728 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57f78659-5d12-43f9-80ef-8767e49387ce tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:13.120147 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57f78659-5d12-43f9-80ef-8767e49387ce tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:13.120583 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57f78659-5d12-43f9-80ef-8767e49387ce tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:13.121329 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57f78659-5d12-43f9-80ef-8767e49387ce tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:13.132945 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57f78659-5d12-43f9-80ef-8767e49387ce tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:13.132945 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57f78659-5d12-43f9-80ef-8767e49387ce tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:13.292505 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-57f78659-5d12-43f9-80ef-8767e49387ce tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:13.304422 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-57f78659-5d12-43f9-80ef-8767e49387ce tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1523 microversion: 2.1 time: 0.198615 Aug 24 03:31:13.305945 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 70/145] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:13 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:14.332405 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-d5b23796-b423-4b7d-889a-d4c44da031c6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:14.334766 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-d5b23796-b423-4b7d-889a-d4c44da031c6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:14.342036 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d5b23796-b423-4b7d-889a-d4c44da031c6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:14.342452 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d5b23796-b423-4b7d-889a-d4c44da031c6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:14.342937 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d5b23796-b423-4b7d-889a-d4c44da031c6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:14.343910 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d5b23796-b423-4b7d-889a-d4c44da031c6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:14.344524 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d5b23796-b423-4b7d-889a-d4c44da031c6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:14.345152 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d5b23796-b423-4b7d-889a-d4c44da031c6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:14.419217 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-56df5200-2da8-4f4c-a754-0a6ad7dcb15d tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:14.420217 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-56df5200-2da8-4f4c-a754-0a6ad7dcb15d tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] [instance: a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:14.427627 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-56df5200-2da8-4f4c-a754-0a6ad7dcb15d tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:14.428250 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-56df5200-2da8-4f4c-a754-0a6ad7dcb15d tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:14.428922 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-56df5200-2da8-4f4c-a754-0a6ad7dcb15d tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:14.430151 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-56df5200-2da8-4f4c-a754-0a6ad7dcb15d tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:14.430838 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-56df5200-2da8-4f4c-a754-0a6ad7dcb15d tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:14.432578 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-56df5200-2da8-4f4c-a754-0a6ad7dcb15d tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:14.495185 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-56df5200-2da8-4f4c-a754-0a6ad7dcb15d tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] [instance: a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f] Going to try to terminate instance {{(pid=120708) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:31:14.540168 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-d5b23796-b423-4b7d-889a-d4c44da031c6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:14.556008 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-d5b23796-b423-4b7d-889a-d4c44da031c6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1523 microversion: 2.1 time: 0.230387 Aug 24 03:31:14.557177 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 76/146] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:14 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1523 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:14.647789 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-56df5200-2da8-4f4c-a754-0a6ad7dcb15d tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f" status: 204 len: 0 microversion: 2.1 time: 0.233621 Aug 24 03:31:14.648369 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 71/147] 10.222.0.81 () {58 vars in 1239 bytes} [Wed Aug 24 03:31:14 2022] DELETE /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:31:14.656799 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-b5171480-e11e-41a8-97f2-f100b7817502 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:14.657427 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-b5171480-e11e-41a8-97f2-f100b7817502 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] [instance: a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:14.671822 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b5171480-e11e-41a8-97f2-f100b7817502 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:14.672528 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b5171480-e11e-41a8-97f2-f100b7817502 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:14.672528 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b5171480-e11e-41a8-97f2-f100b7817502 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:14.675098 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b5171480-e11e-41a8-97f2-f100b7817502 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:14.675098 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b5171480-e11e-41a8-97f2-f100b7817502 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:14.675098 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b5171480-e11e-41a8-97f2-f100b7817502 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:14.830556 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-b5171480-e11e-41a8-97f2-f100b7817502 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bf5ffbf2d47c9b54c4c1e343e8944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be0cbafba614105869a0913a21a127b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:14.839161 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-b5171480-e11e-41a8-97f2-f100b7817502 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] 10.222.0.81 "GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f" status: 200 len: 1554 microversion: 2.1 time: 0.186647 Aug 24 03:31:14.839890 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 77/148] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:14 2022] GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f => generated 1554 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:15.579830 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-468700e3-3818-4232-89ba-a8aabfbf0cd7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:15.581387 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-468700e3-3818-4232-89ba-a8aabfbf0cd7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:15.590286 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-468700e3-3818-4232-89ba-a8aabfbf0cd7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:15.591798 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-468700e3-3818-4232-89ba-a8aabfbf0cd7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:15.592859 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-468700e3-3818-4232-89ba-a8aabfbf0cd7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:15.594977 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-468700e3-3818-4232-89ba-a8aabfbf0cd7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:15.596132 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-468700e3-3818-4232-89ba-a8aabfbf0cd7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:15.596826 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-468700e3-3818-4232-89ba-a8aabfbf0cd7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:15.788876 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-468700e3-3818-4232-89ba-a8aabfbf0cd7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:15.810913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-468700e3-3818-4232-89ba-a8aabfbf0cd7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1523 microversion: 2.1 time: 0.236371 Aug 24 03:31:15.811495 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 72/149] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:15 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1523 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:15.863086 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-203debf7-d015-4701-88c6-88787df08ae0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:15.864425 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-203debf7-d015-4701-88c6-88787df08ae0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] [instance: a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:15.871319 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-203debf7-d015-4701-88c6-88787df08ae0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:15.872603 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-203debf7-d015-4701-88c6-88787df08ae0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:15.873274 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-203debf7-d015-4701-88c6-88787df08ae0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:15.874294 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-203debf7-d015-4701-88c6-88787df08ae0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:15.875081 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-203debf7-d015-4701-88c6-88787df08ae0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:15.875710 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-203debf7-d015-4701-88c6-88787df08ae0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:16.142116 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-203debf7-d015-4701-88c6-88787df08ae0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bf5ffbf2d47c9b54c4c1e343e8944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be0cbafba614105869a0913a21a127b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:16.154816 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-203debf7-d015-4701-88c6-88787df08ae0 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] 10.222.0.81 "GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f" status: 200 len: 1554 microversion: 2.1 time: 0.295520 Aug 24 03:31:16.155406 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 78/150] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:15 2022] GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f => generated 1554 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:16.839001 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0c11e4c3-e189-4968-a839-2a6226671886 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:16.840134 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0c11e4c3-e189-4968-a839-2a6226671886 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:16.848326 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:16.850826 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0c11e4c3-e189-4968-a839-2a6226671886 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:16.851725 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0c11e4c3-e189-4968-a839-2a6226671886 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:16.853208 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0c11e4c3-e189-4968-a839-2a6226671886 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:16.854787 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0c11e4c3-e189-4968-a839-2a6226671886 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:16.855393 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0c11e4c3-e189-4968-a839-2a6226671886 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:16.856713 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0c11e4c3-e189-4968-a839-2a6226671886 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:17.176485 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-b2c4363a-fe73-4d7d-aaca-0a4caa1956e8 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:17.177296 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-b2c4363a-fe73-4d7d-aaca-0a4caa1956e8 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] [instance: a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:17.185368 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0c11e4c3-e189-4968-a839-2a6226671886 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:17.203953 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b2c4363a-fe73-4d7d-aaca-0a4caa1956e8 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:17.204462 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b2c4363a-fe73-4d7d-aaca-0a4caa1956e8 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:17.204962 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b2c4363a-fe73-4d7d-aaca-0a4caa1956e8 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:17.210504 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0c11e4c3-e189-4968-a839-2a6226671886 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1523 microversion: 2.1 time: 0.381744 Aug 24 03:31:17.211589 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 73/151] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:16 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1523 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:17.225217 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b2c4363a-fe73-4d7d-aaca-0a4caa1956e8 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:17.225737 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b2c4363a-fe73-4d7d-aaca-0a4caa1956e8 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:17.226388 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b2c4363a-fe73-4d7d-aaca-0a4caa1956e8 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:17.507168 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-b2c4363a-fe73-4d7d-aaca-0a4caa1956e8 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bf5ffbf2d47c9b54c4c1e343e8944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be0cbafba614105869a0913a21a127b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:17.522771 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-b2c4363a-fe73-4d7d-aaca-0a4caa1956e8 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] 10.222.0.81 "GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f" status: 200 len: 1554 microversion: 2.1 time: 0.348522 Aug 24 03:31:17.525503 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 79/152] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:17 2022] GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f => generated 1554 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:18.233360 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-cc7a5e4c-d08b-4c78-ad55-e6882f11efee tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:18.234826 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-cc7a5e4c-d08b-4c78-ad55-e6882f11efee tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:18.245051 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cc7a5e4c-d08b-4c78-ad55-e6882f11efee tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:18.247530 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cc7a5e4c-d08b-4c78-ad55-e6882f11efee tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:18.248145 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cc7a5e4c-d08b-4c78-ad55-e6882f11efee tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:18.249116 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cc7a5e4c-d08b-4c78-ad55-e6882f11efee tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:18.249711 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cc7a5e4c-d08b-4c78-ad55-e6882f11efee tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:18.250297 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cc7a5e4c-d08b-4c78-ad55-e6882f11efee tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:18.416542 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-c5de302b-2af9-4fc9-8a7c-f98fcfb78759 req-bf4ddd87-8743-47b3-8b58-5b03c9f947d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f", "name": "network-vif-deleted", "tag": "045cb674-6952-47d7-bb5e-17ac22a1ef2e"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:18.444055 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-c5de302b-2af9-4fc9-8a7c-f98fcfb78759 req-bf4ddd87-8743-47b3-8b58-5b03c9f947d9 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:18.444930 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-c5de302b-2af9-4fc9-8a7c-f98fcfb78759 req-bf4ddd87-8743-47b3-8b58-5b03c9f947d9 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:18.445623 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-c5de302b-2af9-4fc9-8a7c-f98fcfb78759 req-bf4ddd87-8743-47b3-8b58-5b03c9f947d9 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:18.505915 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-c5de302b-2af9-4fc9-8a7c-f98fcfb78759 req-bf4ddd87-8743-47b3-8b58-5b03c9f947d9 service nova] Creating event network-vif-deleted:045cb674-6952-47d7-bb5e-17ac22a1ef2e for instance a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f on hv-cinder-85426 Aug 24 03:31:18.520976 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-c5de302b-2af9-4fc9-8a7c-f98fcfb78759 req-bf4ddd87-8743-47b3-8b58-5b03c9f947d9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110362 Aug 24 03:31:18.526805 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 80/153] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:18.547647 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-0361d147-ce01-4648-a220-3d1dca1e0bc3 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:18.548361 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-0361d147-ce01-4648-a220-3d1dca1e0bc3 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] [instance: a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:18.555681 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0361d147-ce01-4648-a220-3d1dca1e0bc3 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:18.556254 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0361d147-ce01-4648-a220-3d1dca1e0bc3 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:18.556629 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0361d147-ce01-4648-a220-3d1dca1e0bc3 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:18.557419 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0361d147-ce01-4648-a220-3d1dca1e0bc3 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:18.557878 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0361d147-ce01-4648-a220-3d1dca1e0bc3 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:18.558810 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0361d147-ce01-4648-a220-3d1dca1e0bc3 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:18.573926 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-cc7a5e4c-d08b-4c78-ad55-e6882f11efee tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:18.586065 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:18.601567 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-cc7a5e4c-d08b-4c78-ad55-e6882f11efee tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1523 microversion: 2.1 time: 0.372432 Aug 24 03:31:18.602153 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 74/154] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:18 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1523 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:18.674410 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-0361d147-ce01-4648-a220-3d1dca1e0bc3 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4bf5ffbf2d47c9b54c4c1e343e8944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be0cbafba614105869a0913a21a127b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:18.683041 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-0361d147-ce01-4648-a220-3d1dca1e0bc3 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] 10.222.0.81 "GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f" status: 200 len: 1346 microversion: 2.1 time: 0.140759 Aug 24 03:31:18.684124 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 81/155] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:18 2022] GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f => generated 1346 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:19.627939 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-e820bd1c-5ead-4c27-9f54-19df7c628573 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:19.628559 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-e820bd1c-5ead-4c27-9f54-19df7c628573 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:19.636229 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e820bd1c-5ead-4c27-9f54-19df7c628573 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:19.636951 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e820bd1c-5ead-4c27-9f54-19df7c628573 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:19.637629 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e820bd1c-5ead-4c27-9f54-19df7c628573 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:19.639450 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e820bd1c-5ead-4c27-9f54-19df7c628573 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:19.640155 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e820bd1c-5ead-4c27-9f54-19df7c628573 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:19.640530 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e820bd1c-5ead-4c27-9f54-19df7c628573 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:19.704523 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-abc97945-cf9d-4a3c-b489-82a437d87f37 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:19.705436 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-abc97945-cf9d-4a3c-b489-82a437d87f37 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] [instance: a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:19.718589 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-abc97945-cf9d-4a3c-b489-82a437d87f37 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:19.720210 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-abc97945-cf9d-4a3c-b489-82a437d87f37 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:19.720944 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-abc97945-cf9d-4a3c-b489-82a437d87f37 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:19.722033 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-abc97945-cf9d-4a3c-b489-82a437d87f37 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:19.722895 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-abc97945-cf9d-4a3c-b489-82a437d87f37 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:19.723809 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-abc97945-cf9d-4a3c-b489-82a437d87f37 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:19.740542 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.wsgi [None req-abc97945-cf9d-4a3c-b489-82a437d87f37 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] HTTP exception thrown: Instance a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f could not be found. Aug 24 03:31:19.745692 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-abc97945-cf9d-4a3c-b489-82a437d87f37 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Request method failure captured: Aug 24 03:31:19.745692 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: request: GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f HTTP/1.1 Aug 24 03:31:19.745692 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept: application/json Aug 24 03:31:19.745692 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept-Encoding: identity Aug 24 03:31:19.745692 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Connection: close Aug 24 03:31:19.745692 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Length: 0 Aug 24 03:31:19.745692 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Type: application/json Aug 24 03:31:19.745692 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Host: 10.222.0.81 Aug 24 03:31:19.745692 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Openstack-System-Scope: None Aug 24 03:31:19.745692 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: User-Agent: python-urllib3/1.26.11 Aug 24 03:31:19.745692 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Auth-Token: gAAAAABjBZtNAJtExx84exT--MCCB6V8NDN_1tF9uPOdLqthQ64HZzOXgjXiY8am8-ISQRDKtC3CwLOAW_WSz5ZhjkJ1cGjWAmMMhWMGo5nfrFSPUB5EFNGdFsXckc4Y8NuUrTpzedKy8fjDzoDAZPma8_EMX-LdR2k2jAcsEKJ7YCGRWM_NuIQ Aug 24 03:31:19.745692 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Id: None Aug 24 03:31:19.745692 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Name: None Aug 24 03:31:19.745692 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Identity-Status: Confirmed Aug 24 03:31:19.745692 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Is-Admin-Project: True Aug 24 03:31:19.745692 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Id: default Aug 24 03:31:19.745692 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Name: Default Aug 24 03:31:19.745692 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Id: 0be0cbafba614105869a0913a21a127b Aug 24 03:31:19.745692 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Name: tempest-DeleteServersTestJSON-76265943 Aug 24 03:31:19.745692 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Role: reader,member Aug 24 03:31:19.745692 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Roles: reader,member Aug 24 03:31:19.747149 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0be0cbafba614105869a0913a21a127b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0be0cbafba614105869a0913a21a127b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0be0cbafba614105869a0913a21a127b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0be0cbafba614105869a0913a21a127b"}]}] Aug 24 03:31:19.747149 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant: tempest-DeleteServersTestJSON-76265943 Aug 24 03:31:19.747149 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Id: 0be0cbafba614105869a0913a21a127b Aug 24 03:31:19.747149 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Name: tempest-DeleteServersTestJSON-76265943 Aug 24 03:31:19.747149 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User: tempest-DeleteServersTestJSON-76265943-project Aug 24 03:31:19.747149 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Id: default Aug 24 03:31:19.747149 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Name: Default Aug 24 03:31:19.747149 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Id: ce4bf5ffbf2d47c9b54c4c1e343e8944 Aug 24 03:31:19.747149 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Name: tempest-DeleteServersTestJSON-76265943-project Aug 24 03:31:19.747149 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: method: > Aug 24 03:31:19.747149 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: exception: Instance a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f could not be found. Aug 24 03:31:19.747149 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: action_args: {'id': 'a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f'} Aug 24 03:31:19.748256 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:31:19.748256 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:19.748256 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:31:19.748256 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:31:19.748256 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:31:19.748256 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:31:19.748256 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:31:19.748256 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:31:19.748256 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:31:19.748256 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:31:19.748256 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f could not be found. Aug 24 03:31:19.748256 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:31:19.748256 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:19.748256 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:31:19.748256 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:19.748256 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:19.748256 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:19.748256 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:31:19.748256 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:31:19.748256 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:31:19.750616 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:31:19.750616 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:31:19.750616 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:31:19.750616 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:31:19.750616 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:31:19.750616 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:31:19.750616 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:31:19.750616 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f could not be found. Aug 24 03:31:19.750616 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:31:19.750616 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:19.750616 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:31:19.750616 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:19.750616 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:19.750616 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:19.750616 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:31:19.750616 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:31:19.750616 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f could not be found. Aug 24 03:31:19.750616 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:31:19.753003 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-abc97945-cf9d-4a3c-b489-82a437d87f37 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Returning 404 to user: Instance a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f could not be found. {{(pid=120709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:31:19.753003 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-abc97945-cf9d-4a3c-b489-82a437d87f37 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] 10.222.0.81 "GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f" status: 404 len: 111 microversion: 2.1 time: 0.047898 Aug 24 03:31:19.753003 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 82/156] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:19 2022] GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:31:19.939403 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-db7437f3-da86-4cc6-a8cb-939a3aafd4d2 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:19.942564 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-db7437f3-da86-4cc6-a8cb-939a3aafd4d2 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] [instance: a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:19.951068 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-db7437f3-da86-4cc6-a8cb-939a3aafd4d2 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:19.952105 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-db7437f3-da86-4cc6-a8cb-939a3aafd4d2 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:19.952609 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-db7437f3-da86-4cc6-a8cb-939a3aafd4d2 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:19.953409 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-db7437f3-da86-4cc6-a8cb-939a3aafd4d2 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:19.954321 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-db7437f3-da86-4cc6-a8cb-939a3aafd4d2 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:19.954806 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-db7437f3-da86-4cc6-a8cb-939a3aafd4d2 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:19.961021 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-e820bd1c-5ead-4c27-9f54-19df7c628573 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:19.972416 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.wsgi [None req-db7437f3-da86-4cc6-a8cb-939a3aafd4d2 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] HTTP exception thrown: Instance a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f could not be found. Aug 24 03:31:19.975060 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-db7437f3-da86-4cc6-a8cb-939a3aafd4d2 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Request method failure captured: Aug 24 03:31:19.975060 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: request: GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f/os-volume_attachments HTTP/1.1 Aug 24 03:31:19.975060 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept: application/json Aug 24 03:31:19.975060 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept-Encoding: identity Aug 24 03:31:19.975060 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Connection: close Aug 24 03:31:19.975060 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Length: 0 Aug 24 03:31:19.975060 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Type: application/json Aug 24 03:31:19.975060 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Host: 10.222.0.81 Aug 24 03:31:19.975060 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Openstack-System-Scope: None Aug 24 03:31:19.975060 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: User-Agent: python-urllib3/1.26.11 Aug 24 03:31:19.975060 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Auth-Token: gAAAAABjBZtNAJtExx84exT--MCCB6V8NDN_1tF9uPOdLqthQ64HZzOXgjXiY8am8-ISQRDKtC3CwLOAW_WSz5ZhjkJ1cGjWAmMMhWMGo5nfrFSPUB5EFNGdFsXckc4Y8NuUrTpzedKy8fjDzoDAZPma8_EMX-LdR2k2jAcsEKJ7YCGRWM_NuIQ Aug 24 03:31:19.975060 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Id: None Aug 24 03:31:19.975060 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Name: None Aug 24 03:31:19.975060 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Identity-Status: Confirmed Aug 24 03:31:19.975060 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Is-Admin-Project: True Aug 24 03:31:19.975060 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Id: default Aug 24 03:31:19.975060 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Name: Default Aug 24 03:31:19.975060 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Id: 0be0cbafba614105869a0913a21a127b Aug 24 03:31:19.975060 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Name: tempest-DeleteServersTestJSON-76265943 Aug 24 03:31:19.975060 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Role: reader,member Aug 24 03:31:19.975060 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Roles: reader,member Aug 24 03:31:19.976596 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0be0cbafba614105869a0913a21a127b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0be0cbafba614105869a0913a21a127b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0be0cbafba614105869a0913a21a127b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0be0cbafba614105869a0913a21a127b"}]}] Aug 24 03:31:19.976596 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant: tempest-DeleteServersTestJSON-76265943 Aug 24 03:31:19.976596 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Id: 0be0cbafba614105869a0913a21a127b Aug 24 03:31:19.976596 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Name: tempest-DeleteServersTestJSON-76265943 Aug 24 03:31:19.976596 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User: tempest-DeleteServersTestJSON-76265943-project Aug 24 03:31:19.976596 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Id: default Aug 24 03:31:19.976596 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Name: Default Aug 24 03:31:19.976596 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Id: ce4bf5ffbf2d47c9b54c4c1e343e8944 Aug 24 03:31:19.976596 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Name: tempest-DeleteServersTestJSON-76265943-project Aug 24 03:31:19.976596 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: method: > Aug 24 03:31:19.976596 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: exception: Instance a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f could not be found. Aug 24 03:31:19.976596 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: action_args: {'server_id': 'a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f'} Aug 24 03:31:19.977446 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:31:19.977446 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:19.977446 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:31:19.977446 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:31:19.977446 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:31:19.977446 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:31:19.977446 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:31:19.977446 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:31:19.977446 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:31:19.977446 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:31:19.977446 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f could not be found. Aug 24 03:31:19.977446 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:31:19.977446 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:19.977446 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:31:19.977446 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:19.977446 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:19.977446 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:19.977446 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:31:19.977446 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:31:19.977446 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:31:19.978646 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:31:19.978646 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 03:31:19.978646 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:31:19.978646 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 03:31:19.978646 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:31:19.978646 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 03:31:19.978646 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 03:31:19.978646 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:31:19.978646 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:31:19.978646 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f could not be found. Aug 24 03:31:19.978646 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:31:19.978646 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:19.978646 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:31:19.978646 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:19.978646 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:19.978646 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:19.978646 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:31:19.978646 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:31:19.978646 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f could not be found. Aug 24 03:31:19.978646 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:31:19.980055 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-db7437f3-da86-4cc6-a8cb-939a3aafd4d2 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Returning 404 to user: Instance a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f could not be found. {{(pid=120709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:31:19.980140 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-e820bd1c-5ead-4c27-9f54-19df7c628573 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1523 microversion: 2.1 time: 0.356220 Aug 24 03:31:19.980140 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 75/157] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:19 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1523 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:19.982211 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-db7437f3-da86-4cc6-a8cb-939a3aafd4d2 tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] 10.222.0.81 "GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.047132 Aug 24 03:31:19.983132 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 83/158] 10.222.0.81 () {58 vars in 1302 bytes} [Wed Aug 24 03:31:19 2022] GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f/os-volume_attachments => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:31:21.000889 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c0d2a255-d659-4655-a895-0238efb4a8ea tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:21.001640 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c0d2a255-d659-4655-a895-0238efb4a8ea tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:21.009074 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c0d2a255-d659-4655-a895-0238efb4a8ea tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:21.009671 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c0d2a255-d659-4655-a895-0238efb4a8ea tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:21.010200 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c0d2a255-d659-4655-a895-0238efb4a8ea tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:21.011013 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c0d2a255-d659-4655-a895-0238efb4a8ea tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:21.011588 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c0d2a255-d659-4655-a895-0238efb4a8ea tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:21.012251 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c0d2a255-d659-4655-a895-0238efb4a8ea tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:21.197608 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c0d2a255-d659-4655-a895-0238efb4a8ea tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:21.211768 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c0d2a255-d659-4655-a895-0238efb4a8ea tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1523 microversion: 2.1 time: 0.215112 Aug 24 03:31:21.212156 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 76/159] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:20 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1523 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:21.283615 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-1c646f51-0f4b-4af2-88d1-0f7bf8be12aa tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:21.285889 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-1c646f51-0f4b-4af2-88d1-0f7bf8be12aa tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] [instance: a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:21.292920 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1c646f51-0f4b-4af2-88d1-0f7bf8be12aa tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:21.293478 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1c646f51-0f4b-4af2-88d1-0f7bf8be12aa tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:21.295022 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1c646f51-0f4b-4af2-88d1-0f7bf8be12aa tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:21.296313 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1c646f51-0f4b-4af2-88d1-0f7bf8be12aa tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:21.296872 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1c646f51-0f4b-4af2-88d1-0f7bf8be12aa tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:21.297302 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1c646f51-0f4b-4af2-88d1-0f7bf8be12aa tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:21.314686 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.wsgi [None req-1c646f51-0f4b-4af2-88d1-0f7bf8be12aa tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] HTTP exception thrown: Instance a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f could not be found. Aug 24 03:31:21.317093 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-1c646f51-0f4b-4af2-88d1-0f7bf8be12aa tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Request method failure captured: Aug 24 03:31:21.317093 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: request: DELETE /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f HTTP/1.1 Aug 24 03:31:21.317093 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept: application/json Aug 24 03:31:21.317093 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept-Encoding: identity Aug 24 03:31:21.317093 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Connection: close Aug 24 03:31:21.317093 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Length: 0 Aug 24 03:31:21.317093 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Type: application/json Aug 24 03:31:21.317093 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Host: 10.222.0.81 Aug 24 03:31:21.317093 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Openstack-System-Scope: None Aug 24 03:31:21.317093 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: User-Agent: python-urllib3/1.26.11 Aug 24 03:31:21.317093 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Auth-Token: gAAAAABjBZtNAJtExx84exT--MCCB6V8NDN_1tF9uPOdLqthQ64HZzOXgjXiY8am8-ISQRDKtC3CwLOAW_WSz5ZhjkJ1cGjWAmMMhWMGo5nfrFSPUB5EFNGdFsXckc4Y8NuUrTpzedKy8fjDzoDAZPma8_EMX-LdR2k2jAcsEKJ7YCGRWM_NuIQ Aug 24 03:31:21.317093 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Id: None Aug 24 03:31:21.317093 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Name: None Aug 24 03:31:21.317093 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Identity-Status: Confirmed Aug 24 03:31:21.317093 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Is-Admin-Project: True Aug 24 03:31:21.317093 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Id: default Aug 24 03:31:21.317093 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Name: Default Aug 24 03:31:21.317093 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Id: 0be0cbafba614105869a0913a21a127b Aug 24 03:31:21.317093 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Name: tempest-DeleteServersTestJSON-76265943 Aug 24 03:31:21.317093 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Role: reader,member Aug 24 03:31:21.317093 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Roles: reader,member Aug 24 03:31:21.318320 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0be0cbafba614105869a0913a21a127b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0be0cbafba614105869a0913a21a127b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0be0cbafba614105869a0913a21a127b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0be0cbafba614105869a0913a21a127b"}]}] Aug 24 03:31:21.318320 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant: tempest-DeleteServersTestJSON-76265943 Aug 24 03:31:21.318320 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Id: 0be0cbafba614105869a0913a21a127b Aug 24 03:31:21.318320 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Name: tempest-DeleteServersTestJSON-76265943 Aug 24 03:31:21.318320 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User: tempest-DeleteServersTestJSON-76265943-project Aug 24 03:31:21.318320 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Id: default Aug 24 03:31:21.318320 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Name: Default Aug 24 03:31:21.318320 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Id: ce4bf5ffbf2d47c9b54c4c1e343e8944 Aug 24 03:31:21.318320 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Name: tempest-DeleteServersTestJSON-76265943-project Aug 24 03:31:21.318320 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: method: > Aug 24 03:31:21.318320 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: exception: Instance a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f could not be found. Aug 24 03:31:21.318320 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: action_args: {'id': 'a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f'} Aug 24 03:31:21.318995 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:31:21.318995 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:21.318995 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:31:21.318995 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:31:21.318995 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:31:21.318995 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:31:21.318995 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:31:21.318995 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:31:21.318995 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:31:21.318995 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:31:21.318995 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f could not be found. Aug 24 03:31:21.318995 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:31:21.318995 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:21.318995 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:31:21.318995 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:21.318995 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:21.318995 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:21.318995 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:31:21.318995 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:31:21.318995 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:31:21.322700 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:31:21.322700 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:31:21.322700 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:31:21.322700 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:31:21.322700 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:31:21.322700 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:31:21.322700 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:31:21.322700 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:31:21.322700 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:31:21.322700 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f could not be found. Aug 24 03:31:21.322700 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:31:21.322700 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:21.322700 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:31:21.322700 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:21.322700 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:21.322700 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:21.322700 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:31:21.322700 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:31:21.322700 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f could not be found. Aug 24 03:31:21.322700 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:31:21.323781 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-1c646f51-0f4b-4af2-88d1-0f7bf8be12aa tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Returning 404 to user: Instance a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f could not be found. {{(pid=120709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:31:21.323781 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-1c646f51-0f4b-4af2-88d1-0f7bf8be12aa tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f" status: 404 len: 111 microversion: 2.1 time: 0.042341 Aug 24 03:31:21.323781 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 84/160] 10.222.0.81 () {58 vars in 1239 bytes} [Wed Aug 24 03:31:21 2022] DELETE /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:31:21.327737 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1c320eec-df5a-42d0-acd0-3700ab18474c tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:21.328356 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1c320eec-df5a-42d0-acd0-3700ab18474c tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] [instance: a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:21.334372 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1c320eec-df5a-42d0-acd0-3700ab18474c tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:21.334862 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1c320eec-df5a-42d0-acd0-3700ab18474c tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:21.335295 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1c320eec-df5a-42d0-acd0-3700ab18474c tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:21.335993 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1c320eec-df5a-42d0-acd0-3700ab18474c tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:21.336612 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1c320eec-df5a-42d0-acd0-3700ab18474c tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:21.337419 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1c320eec-df5a-42d0-acd0-3700ab18474c tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:21.353457 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-1c320eec-df5a-42d0-acd0-3700ab18474c tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] HTTP exception thrown: Instance a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f could not be found. Aug 24 03:31:21.359016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1c320eec-df5a-42d0-acd0-3700ab18474c tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Request method failure captured: Aug 24 03:31:21.359016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f HTTP/1.1 Aug 24 03:31:21.359016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 24 03:31:21.359016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 24 03:31:21.359016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Connection: close Aug 24 03:31:21.359016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 24 03:31:21.359016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 24 03:31:21.359016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Host: 10.222.0.81 Aug 24 03:31:21.359016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 24 03:31:21.359016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.11 Aug 24 03:31:21.359016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjBZtNAJtExx84exT--MCCB6V8NDN_1tF9uPOdLqthQ64HZzOXgjXiY8am8-ISQRDKtC3CwLOAW_WSz5ZhjkJ1cGjWAmMMhWMGo5nfrFSPUB5EFNGdFsXckc4Y8NuUrTpzedKy8fjDzoDAZPma8_EMX-LdR2k2jAcsEKJ7YCGRWM_NuIQ Aug 24 03:31:21.359016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 24 03:31:21.359016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 24 03:31:21.359016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 24 03:31:21.359016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 24 03:31:21.359016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 24 03:31:21.359016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 24 03:31:21.359016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Id: 0be0cbafba614105869a0913a21a127b Aug 24 03:31:21.359016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-DeleteServersTestJSON-76265943 Aug 24 03:31:21.359016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 24 03:31:21.359016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 24 03:31:21.360369 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0be0cbafba614105869a0913a21a127b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0be0cbafba614105869a0913a21a127b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0be0cbafba614105869a0913a21a127b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0be0cbafba614105869a0913a21a127b"}]}] Aug 24 03:31:21.360369 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-DeleteServersTestJSON-76265943 Aug 24 03:31:21.360369 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 0be0cbafba614105869a0913a21a127b Aug 24 03:31:21.360369 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-DeleteServersTestJSON-76265943 Aug 24 03:31:21.360369 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User: tempest-DeleteServersTestJSON-76265943-project Aug 24 03:31:21.360369 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 24 03:31:21.360369 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 24 03:31:21.360369 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Id: ce4bf5ffbf2d47c9b54c4c1e343e8944 Aug 24 03:31:21.360369 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-DeleteServersTestJSON-76265943-project Aug 24 03:31:21.360369 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: method: > Aug 24 03:31:21.360369 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: exception: Instance a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f could not be found. Aug 24 03:31:21.360369 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: action_args: {'id': 'a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f'} Aug 24 03:31:21.361058 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:31:21.361058 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:21.361058 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:31:21.361058 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:31:21.361058 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:31:21.361058 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:31:21.361058 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:31:21.361058 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:31:21.361058 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:31:21.361058 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:31:21.361058 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f could not be found. Aug 24 03:31:21.361058 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:31:21.361058 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:21.361058 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:31:21.361058 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:21.361058 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:21.361058 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:21.361058 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:31:21.361058 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:31:21.361058 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:31:21.362090 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:31:21.362090 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:31:21.362090 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:31:21.362090 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:31:21.362090 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:31:21.362090 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:31:21.362090 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:31:21.362090 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f could not be found. Aug 24 03:31:21.362090 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:31:21.362090 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:21.362090 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:31:21.362090 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:21.362090 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:21.362090 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:21.362090 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:31:21.362090 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:31:21.362090 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f could not be found. Aug 24 03:31:21.362090 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:31:21.364367 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1c320eec-df5a-42d0-acd0-3700ab18474c tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] Returning 404 to user: Instance a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:31:21.365364 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1c320eec-df5a-42d0-acd0-3700ab18474c tempest-DeleteServersTestJSON-76265943 tempest-DeleteServersTestJSON-76265943-project] 10.222.0.81 "GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f" status: 404 len: 111 microversion: 2.1 time: 0.042144 Aug 24 03:31:21.366038 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 77/161] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:21 2022] GET /compute/v2.1/servers/a8f18bb2-84ee-4ad8-b88a-f8f3ded7de2f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:31:22.237056 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-af40c9c8-6e75-4dfe-a9db-41c9b88b4dfb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:22.237665 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-af40c9c8-6e75-4dfe-a9db-41c9b88b4dfb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:22.245130 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-af40c9c8-6e75-4dfe-a9db-41c9b88b4dfb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:22.246870 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-af40c9c8-6e75-4dfe-a9db-41c9b88b4dfb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:22.247528 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-af40c9c8-6e75-4dfe-a9db-41c9b88b4dfb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:22.248641 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-af40c9c8-6e75-4dfe-a9db-41c9b88b4dfb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:22.249121 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-af40c9c8-6e75-4dfe-a9db-41c9b88b4dfb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:22.249537 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-af40c9c8-6e75-4dfe-a9db-41c9b88b4dfb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:22.542890 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-af40c9c8-6e75-4dfe-a9db-41c9b88b4dfb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:22.568700 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-af40c9c8-6e75-4dfe-a9db-41c9b88b4dfb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1523 microversion: 2.1 time: 0.335455 Aug 24 03:31:22.573637 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 85/162] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:22 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1523 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:23.595279 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-874927a3-d067-4cbd-b099-c209ceb8fc3c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:23.596040 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-874927a3-d067-4cbd-b099-c209ceb8fc3c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:23.603210 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-874927a3-d067-4cbd-b099-c209ceb8fc3c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:23.603782 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-874927a3-d067-4cbd-b099-c209ceb8fc3c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:23.604296 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-874927a3-d067-4cbd-b099-c209ceb8fc3c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:23.605106 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-874927a3-d067-4cbd-b099-c209ceb8fc3c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:23.605731 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-874927a3-d067-4cbd-b099-c209ceb8fc3c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:23.606155 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-874927a3-d067-4cbd-b099-c209ceb8fc3c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:23.864145 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-874927a3-d067-4cbd-b099-c209ceb8fc3c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:23.874064 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-874927a3-d067-4cbd-b099-c209ceb8fc3c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1523 microversion: 2.1 time: 0.282875 Aug 24 03:31:23.875247 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 78/163] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:23 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1523 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:24.905924 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-b55ba832-08fd-4162-8b8d-7a8f6e277932 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:24.907153 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-b55ba832-08fd-4162-8b8d-7a8f6e277932 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:24.916724 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b55ba832-08fd-4162-8b8d-7a8f6e277932 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:24.917245 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b55ba832-08fd-4162-8b8d-7a8f6e277932 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:24.917747 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b55ba832-08fd-4162-8b8d-7a8f6e277932 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:24.918604 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b55ba832-08fd-4162-8b8d-7a8f6e277932 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:24.919060 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b55ba832-08fd-4162-8b8d-7a8f6e277932 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:24.920100 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b55ba832-08fd-4162-8b8d-7a8f6e277932 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:25.245647 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-b55ba832-08fd-4162-8b8d-7a8f6e277932 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:25.253769 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-b55ba832-08fd-4162-8b8d-7a8f6e277932 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1523 microversion: 2.1 time: 0.359412 Aug 24 03:31:25.254473 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 86/164] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:24 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1523 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:26.147059 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-92582484-465e-41c5-b4c9-24e440dccc6f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-540101163", "imageRef": "b7a40f0c-20c2-44cd-8b0e-f6e73a007d3e", "flavorRef": "452", "networks": [{"uuid": "d8b14bbe-b5e3-4c85-93fd-466ec3cf3434"}]}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:26.237271 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.network.neutron [None req-92582484-465e-41c5-b4c9-24e440dccc6f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] validate_networks() for [('d8b14bbe-b5e3-4c85-93fd-466ec3cf3434', None, None, None, None, None)] {{(pid=120708) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:31:26.276821 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-2ba525e4-6ae1-43d6-b8e3-07667cae5af4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:26.276821 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-2ba525e4-6ae1-43d6-b8e3-07667cae5af4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:26.292485 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2ba525e4-6ae1-43d6-b8e3-07667cae5af4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:26.296373 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2ba525e4-6ae1-43d6-b8e3-07667cae5af4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:26.299560 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2ba525e4-6ae1-43d6-b8e3-07667cae5af4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:26.300514 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2ba525e4-6ae1-43d6-b8e3-07667cae5af4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:26.301195 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2ba525e4-6ae1-43d6-b8e3-07667cae5af4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:26.301510 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2ba525e4-6ae1-43d6-b8e3-07667cae5af4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:26.567309 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-2ba525e4-6ae1-43d6-b8e3-07667cae5af4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:26.578078 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-2ba525e4-6ae1-43d6-b8e3-07667cae5af4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1523 microversion: 2.1 time: 0.306420 Aug 24 03:31:26.579044 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 87/165] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:26 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1523 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:31:26.739562 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-92582484-465e-41c5-b4c9-24e440dccc6f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Flavor limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:31:26.739996 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-92582484-465e-41c5-b4c9-24e440dccc6f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Image limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:31:26.740475 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-92582484-465e-41c5-b4c9-24e440dccc6f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Flavor pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:31:26.740915 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-92582484-465e-41c5-b4c9-24e440dccc6f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Image pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:31:26.741330 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-92582484-465e-41c5-b4c9-24e440dccc6f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:31:26.751333 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-92582484-465e-41c5-b4c9-24e440dccc6f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:26.751819 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-92582484-465e-41c5-b4c9-24e440dccc6f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:26.752340 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-92582484-465e-41c5-b4c9-24e440dccc6f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:26.753490 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-92582484-465e-41c5-b4c9-24e440dccc6f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:26.753955 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-92582484-465e-41c5-b4c9-24e440dccc6f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:26.754395 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-92582484-465e-41c5-b4c9-24e440dccc6f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:26.771596 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-92582484-465e-41c5-b4c9-24e440dccc6f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Getting quotas for project f82c6dd205d640a4a78c23050a8f73af. Resources: {'ram', 'instances', 'cores'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:26.775667 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-92582484-465e-41c5-b4c9-24e440dccc6f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Getting quotas for user ed0a2e4acb9f4eab98f96e3fa3001099 and project f82c6dd205d640a4a78c23050a8f73af. Resources: {'ram', 'instances', 'cores'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:26.787134 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-92582484-465e-41c5-b4c9-24e440dccc6f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Going to run 1 instances... {{(pid=120708) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:31:26.789764 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-92582484-465e-41c5-b4c9-24e440dccc6f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 40fde0c1-f011-4e1b-a4fa-cecb0d44132b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b7a40f0c-20c2-44cd-8b0e-f6e73a007d3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120708) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:31:26.840740 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-92582484-465e-41c5-b4c9-24e440dccc6f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.697797 Aug 24 03:31:26.841972 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 79/166] 10.222.0.81 () {60 vars in 1147 bytes} [Wed Aug 24 03:31:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:31:26.852571 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-91ea3864-53da-489c-af34-b9327fed6584 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:26.853279 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-91ea3864-53da-489c-af34-b9327fed6584 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 40fde0c1-f011-4e1b-a4fa-cecb0d44132b] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:26.924984 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-91ea3864-53da-489c-af34-b9327fed6584 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a2e4acb9f4eab98f96e3fa3001099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82c6dd205d640a4a78c23050a8f73af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:26.939173 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-91ea3864-53da-489c-af34-b9327fed6584 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b" status: 200 len: 1213 microversion: 2.1 time: 0.090291 Aug 24 03:31:26.939754 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 88/167] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:26 2022] GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:27.600298 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-75a71b09-461c-4dbd-b963-ed8e419fcfe5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:27.600982 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-75a71b09-461c-4dbd-b963-ed8e419fcfe5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:27.608202 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-75a71b09-461c-4dbd-b963-ed8e419fcfe5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:27.608698 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-75a71b09-461c-4dbd-b963-ed8e419fcfe5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:27.609174 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-75a71b09-461c-4dbd-b963-ed8e419fcfe5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:27.609878 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-75a71b09-461c-4dbd-b963-ed8e419fcfe5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:27.610334 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-75a71b09-461c-4dbd-b963-ed8e419fcfe5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:27.610761 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-75a71b09-461c-4dbd-b963-ed8e419fcfe5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:27.819736 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-75a71b09-461c-4dbd-b963-ed8e419fcfe5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:27.829877 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-75a71b09-461c-4dbd-b963-ed8e419fcfe5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1523 microversion: 2.1 time: 0.233982 Aug 24 03:31:27.830639 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 80/168] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:27 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:27.960273 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-8ee68af1-1a6a-4841-8442-96973563d29b tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:27.961134 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-8ee68af1-1a6a-4841-8442-96973563d29b tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 40fde0c1-f011-4e1b-a4fa-cecb0d44132b] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:27.968317 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8ee68af1-1a6a-4841-8442-96973563d29b tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:27.968937 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8ee68af1-1a6a-4841-8442-96973563d29b tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:27.969447 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8ee68af1-1a6a-4841-8442-96973563d29b tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:27.970268 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8ee68af1-1a6a-4841-8442-96973563d29b tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:27.970876 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8ee68af1-1a6a-4841-8442-96973563d29b tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:27.971434 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8ee68af1-1a6a-4841-8442-96973563d29b tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:28.053601 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-8ee68af1-1a6a-4841-8442-96973563d29b tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a2e4acb9f4eab98f96e3fa3001099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82c6dd205d640a4a78c23050a8f73af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:28.062207 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-8ee68af1-1a6a-4841-8442-96973563d29b tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b" status: 200 len: 1217 microversion: 2.1 time: 0.106219 Aug 24 03:31:28.063015 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 89/169] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:27 2022] GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b => generated 1217 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:28.851707 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-87fac0bf-f47a-4b11-ab77-64f9d238fdcc tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:28.852925 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-87fac0bf-f47a-4b11-ab77-64f9d238fdcc tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:28.859798 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-87fac0bf-f47a-4b11-ab77-64f9d238fdcc tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:28.860488 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-87fac0bf-f47a-4b11-ab77-64f9d238fdcc tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:28.861124 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-87fac0bf-f47a-4b11-ab77-64f9d238fdcc tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:28.862007 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-87fac0bf-f47a-4b11-ab77-64f9d238fdcc tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:28.862613 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-87fac0bf-f47a-4b11-ab77-64f9d238fdcc tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:28.863192 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-87fac0bf-f47a-4b11-ab77-64f9d238fdcc tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:29.054713 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-87fac0bf-f47a-4b11-ab77-64f9d238fdcc tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:29.074868 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-87fac0bf-f47a-4b11-ab77-64f9d238fdcc tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1523 microversion: 2.1 time: 0.227226 Aug 24 03:31:29.083388 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-5fe62ff7-d3cb-405e-87f5-7b44c57fdc83 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:29.084529 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-5fe62ff7-d3cb-405e-87f5-7b44c57fdc83 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 40fde0c1-f011-4e1b-a4fa-cecb0d44132b] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:29.090144 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 81/170] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:28 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1523 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:29.092592 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5fe62ff7-d3cb-405e-87f5-7b44c57fdc83 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:29.093239 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5fe62ff7-d3cb-405e-87f5-7b44c57fdc83 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:29.093843 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5fe62ff7-d3cb-405e-87f5-7b44c57fdc83 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:29.094704 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5fe62ff7-d3cb-405e-87f5-7b44c57fdc83 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:29.095492 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5fe62ff7-d3cb-405e-87f5-7b44c57fdc83 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:29.096080 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5fe62ff7-d3cb-405e-87f5-7b44c57fdc83 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:29.201479 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-5fe62ff7-d3cb-405e-87f5-7b44c57fdc83 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a2e4acb9f4eab98f96e3fa3001099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82c6dd205d640a4a78c23050a8f73af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:29.212215 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-5fe62ff7-d3cb-405e-87f5-7b44c57fdc83 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b" status: 200 len: 1265 microversion: 2.1 time: 0.132494 Aug 24 03:31:29.221235 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 90/171] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:29 2022] GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b => generated 1265 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:30.098576 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-12b95ce0-8dc8-4cfa-9595-00831602e14e tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:30.099845 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-12b95ce0-8dc8-4cfa-9595-00831602e14e tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:30.111450 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-12b95ce0-8dc8-4cfa-9595-00831602e14e tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:30.112137 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-12b95ce0-8dc8-4cfa-9595-00831602e14e tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:30.112940 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-12b95ce0-8dc8-4cfa-9595-00831602e14e tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:30.113822 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-12b95ce0-8dc8-4cfa-9595-00831602e14e tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:30.114722 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-12b95ce0-8dc8-4cfa-9595-00831602e14e tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:30.115818 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-12b95ce0-8dc8-4cfa-9595-00831602e14e tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:30.235726 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-0f611d78-45db-4765-bb93-8e7d435de1fa tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:30.236271 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-0f611d78-45db-4765-bb93-8e7d435de1fa tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 40fde0c1-f011-4e1b-a4fa-cecb0d44132b] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:30.250768 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0f611d78-45db-4765-bb93-8e7d435de1fa tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:30.251644 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0f611d78-45db-4765-bb93-8e7d435de1fa tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:30.252319 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0f611d78-45db-4765-bb93-8e7d435de1fa tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:30.253637 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0f611d78-45db-4765-bb93-8e7d435de1fa tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:30.254306 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0f611d78-45db-4765-bb93-8e7d435de1fa tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:30.254939 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0f611d78-45db-4765-bb93-8e7d435de1fa tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:30.386161 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-0f611d78-45db-4765-bb93-8e7d435de1fa tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a2e4acb9f4eab98f96e3fa3001099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82c6dd205d640a4a78c23050a8f73af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:30.401431 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-0f611d78-45db-4765-bb93-8e7d435de1fa tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b" status: 200 len: 1271 microversion: 2.1 time: 0.170634 Aug 24 03:31:30.402411 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 91/172] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:30 2022] GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b => generated 1271 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:30.586287 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-12b95ce0-8dc8-4cfa-9595-00831602e14e tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:30.603857 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-12b95ce0-8dc8-4cfa-9595-00831602e14e tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1523 microversion: 2.1 time: 0.509408 Aug 24 03:31:30.606509 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 82/173] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:30 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1523 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:31.431883 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-639cf570-a365-400f-a900-693499e6629a tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:31.432749 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-639cf570-a365-400f-a900-693499e6629a tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 40fde0c1-f011-4e1b-a4fa-cecb0d44132b] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:31.441539 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-639cf570-a365-400f-a900-693499e6629a tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:31.442078 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-639cf570-a365-400f-a900-693499e6629a tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:31.446177 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-639cf570-a365-400f-a900-693499e6629a tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:31.455095 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-639cf570-a365-400f-a900-693499e6629a tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:31.455604 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-639cf570-a365-400f-a900-693499e6629a tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:31.456050 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-639cf570-a365-400f-a900-693499e6629a tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:31.635185 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1fb9a5e6-be26-4b43-a461-b119504c1e71 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:31.636043 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1fb9a5e6-be26-4b43-a461-b119504c1e71 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:31.649493 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1fb9a5e6-be26-4b43-a461-b119504c1e71 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:31.650218 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1fb9a5e6-be26-4b43-a461-b119504c1e71 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:31.651167 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1fb9a5e6-be26-4b43-a461-b119504c1e71 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:31.652676 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1fb9a5e6-be26-4b43-a461-b119504c1e71 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:31.653810 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1fb9a5e6-be26-4b43-a461-b119504c1e71 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:31.655130 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1fb9a5e6-be26-4b43-a461-b119504c1e71 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:31.976356 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1fb9a5e6-be26-4b43-a461-b119504c1e71 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:31.992701 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-639cf570-a365-400f-a900-693499e6629a tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a2e4acb9f4eab98f96e3fa3001099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82c6dd205d640a4a78c23050a8f73af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:32.011656 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-639cf570-a365-400f-a900-693499e6629a tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b" status: 200 len: 1313 microversion: 2.1 time: 0.582362 Aug 24 03:31:32.012160 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1fb9a5e6-be26-4b43-a461-b119504c1e71 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1523 microversion: 2.1 time: 0.383436 Aug 24 03:31:32.012929 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 83/174] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:31 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1523 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:32.014742 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 92/175] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:31 2022] GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b => generated 1313 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:32.103015 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-dde4757e-f469-4637-b0cb-7af060c92b9d req-bd0a423e-ec97-44b3-a87d-917efdd0557f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40fde0c1-f011-4e1b-a4fa-cecb0d44132b", "tag": "2e9d914d-9e52-489f-bd3b-ace15db6dd1d"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:32.132003 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-dde4757e-f469-4637-b0cb-7af060c92b9d req-bd0a423e-ec97-44b3-a87d-917efdd0557f service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:32.136886 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-dde4757e-f469-4637-b0cb-7af060c92b9d req-bd0a423e-ec97-44b3-a87d-917efdd0557f service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:32.137760 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-dde4757e-f469-4637-b0cb-7af060c92b9d req-bd0a423e-ec97-44b3-a87d-917efdd0557f service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:32.175101 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-dde4757e-f469-4637-b0cb-7af060c92b9d req-bd0a423e-ec97-44b3-a87d-917efdd0557f service nova] Creating event network-changed:2e9d914d-9e52-489f-bd3b-ace15db6dd1d for instance 40fde0c1-f011-4e1b-a4fa-cecb0d44132b on hv-cinder-85426 Aug 24 03:31:32.183975 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-dde4757e-f469-4637-b0cb-7af060c92b9d req-bd0a423e-ec97-44b3-a87d-917efdd0557f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085845 Aug 24 03:31:32.184814 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 84/176] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:32.982692 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-48170750-bd34-4bf8-9729-20d26b41fef1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Action: 'create', calling method: .version_select at 0x7f942fd54820>, body: {"keypair": {"name": "tempest-keypair-681882413", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTqrdgGfw4OByia2ANqXYHl8dvYwSRlyqutKQ7YAahbb2puTp1RAW/xyPhwmf0an/sIC3Nr26TpOW/Qxe+/UTPG8s0j/2OYrBDVCC+tXsZpW8UCUvgIZv1akFVHrko1jA=="}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:33.004700 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.quota [None req-48170750-bd34-4bf8-9729-20d26b41fef1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Getting quotas for project b5da9e76bed44f3d90144e4fbff2cb1c. Resources: {'key_pairs'} {{(pid=120709) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:33.008607 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.quota [None req-48170750-bd34-4bf8-9729-20d26b41fef1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Getting quotas for user 1af20de2433c44ff8fb1f16290404c21 and project b5da9e76bed44f3d90144e4fbff2cb1c. Resources: {'key_pairs'} {{(pid=120709) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:33.049575 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f21efb0c-2189-41cf-96c1-353d3f6e2d04 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:33.050564 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f21efb0c-2189-41cf-96c1-353d3f6e2d04 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 40fde0c1-f011-4e1b-a4fa-cecb0d44132b] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:33.057576 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-48170750-bd34-4bf8-9729-20d26b41fef1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.256818 Aug 24 03:31:33.057995 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f21efb0c-2189-41cf-96c1-353d3f6e2d04 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:33.064471 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 93/177] 10.222.0.81 () {62 vars in 1200 bytes} [Wed Aug 24 03:31:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 259 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 03:31:33.064471 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-f1729201-b3d8-4cdb-a6c6-0ed9f535f8d9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:33.064471 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-f1729201-b3d8-4cdb-a6c6-0ed9f535f8d9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:33.065838 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f21efb0c-2189-41cf-96c1-353d3f6e2d04 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:33.066435 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f21efb0c-2189-41cf-96c1-353d3f6e2d04 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:33.067179 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f21efb0c-2189-41cf-96c1-353d3f6e2d04 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:33.067785 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f21efb0c-2189-41cf-96c1-353d3f6e2d04 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:33.068426 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f21efb0c-2189-41cf-96c1-353d3f6e2d04 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:33.071127 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f1729201-b3d8-4cdb-a6c6-0ed9f535f8d9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:33.071926 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f1729201-b3d8-4cdb-a6c6-0ed9f535f8d9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:33.072373 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f1729201-b3d8-4cdb-a6c6-0ed9f535f8d9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:33.073123 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f1729201-b3d8-4cdb-a6c6-0ed9f535f8d9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:33.073590 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f1729201-b3d8-4cdb-a6c6-0ed9f535f8d9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:33.074220 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f1729201-b3d8-4cdb-a6c6-0ed9f535f8d9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:33.091723 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell1:SELECT=100 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:33.341789 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f21efb0c-2189-41cf-96c1-353d3f6e2d04 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a2e4acb9f4eab98f96e3fa3001099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82c6dd205d640a4a78c23050a8f73af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:33.356874 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-f1729201-b3d8-4cdb-a6c6-0ed9f535f8d9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:33.359521 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f21efb0c-2189-41cf-96c1-353d3f6e2d04 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b" status: 200 len: 1313 microversion: 2.1 time: 0.315625 Aug 24 03:31:33.373323 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-f1729201-b3d8-4cdb-a6c6-0ed9f535f8d9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1523 microversion: 2.1 time: 0.306661 Aug 24 03:31:33.373323 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 94/178] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:33 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1523 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:33.377098 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 85/179] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:33 2022] GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b => generated 1313 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:31:34.387049 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-6618a987-3321-490e-863a-a490b5c87e16 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:34.391555 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-6618a987-3321-490e-863a-a490b5c87e16 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 40fde0c1-f011-4e1b-a4fa-cecb0d44132b] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:34.395712 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-5ddd86db-1ace-4d86-9e64-93bf8aca63ab tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:34.396347 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-5ddd86db-1ace-4d86-9e64-93bf8aca63ab tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:34.412462 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5ddd86db-1ace-4d86-9e64-93bf8aca63ab tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:34.412462 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5ddd86db-1ace-4d86-9e64-93bf8aca63ab tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:34.412462 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5ddd86db-1ace-4d86-9e64-93bf8aca63ab tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:34.414728 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5ddd86db-1ace-4d86-9e64-93bf8aca63ab tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:34.414728 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5ddd86db-1ace-4d86-9e64-93bf8aca63ab tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:34.415118 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5ddd86db-1ace-4d86-9e64-93bf8aca63ab tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:34.417239 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6618a987-3321-490e-863a-a490b5c87e16 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:34.417748 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6618a987-3321-490e-863a-a490b5c87e16 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:34.418195 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6618a987-3321-490e-863a-a490b5c87e16 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:34.421096 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6618a987-3321-490e-863a-a490b5c87e16 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:34.421708 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6618a987-3321-490e-863a-a490b5c87e16 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:34.422155 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6618a987-3321-490e-863a-a490b5c87e16 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:34.807245 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-6618a987-3321-490e-863a-a490b5c87e16 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a2e4acb9f4eab98f96e3fa3001099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82c6dd205d640a4a78c23050a8f73af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:34.813647 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-5ddd86db-1ace-4d86-9e64-93bf8aca63ab tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:34.817306 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-6618a987-3321-490e-863a-a490b5c87e16 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b" status: 200 len: 1313 microversion: 2.1 time: 0.436541 Aug 24 03:31:34.817882 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 95/180] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:34 2022] GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b => generated 1313 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:34.835351 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-5ddd86db-1ace-4d86-9e64-93bf8aca63ab tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1523 microversion: 2.1 time: 0.443570 Aug 24 03:31:34.835930 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 86/181] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:34 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1523 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:35.171554 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-504cf076-7852-4da6-90e1-22298d9e11c8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-153633328", "imageRef": "b7a40f0c-20c2-44cd-8b0e-f6e73a007d3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "52ff60ab-ab6b-4793-b855-63432cd730d4"}], "security_groups": [{"name": "tempest-securitygroup--433961827"}], "key_name": "tempest-keypair-681882413", "user_data": "}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:35.286355 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.network.neutron [None req-504cf076-7852-4da6-90e1-22298d9e11c8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] validate_networks() for [('52ff60ab-ab6b-4793-b855-63432cd730d4', None, None, None, None, None)] {{(pid=120709) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:31:35.741420 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-504cf076-7852-4da6-90e1-22298d9e11c8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Flavor limits 0:0:0 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:31:35.741987 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-504cf076-7852-4da6-90e1-22298d9e11c8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Image limits 0:0:0 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:31:35.742515 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-504cf076-7852-4da6-90e1-22298d9e11c8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Flavor pref 0:0:0 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:31:35.743080 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-504cf076-7852-4da6-90e1-22298d9e11c8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Image pref 0:0:0 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:31:35.743508 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-504cf076-7852-4da6-90e1-22298d9e11c8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:31:35.753278 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-504cf076-7852-4da6-90e1-22298d9e11c8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:35.754015 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-504cf076-7852-4da6-90e1-22298d9e11c8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:35.754446 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-504cf076-7852-4da6-90e1-22298d9e11c8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:35.755201 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-504cf076-7852-4da6-90e1-22298d9e11c8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:35.755830 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-504cf076-7852-4da6-90e1-22298d9e11c8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:35.756255 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-504cf076-7852-4da6-90e1-22298d9e11c8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:35.774125 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.quota [None req-504cf076-7852-4da6-90e1-22298d9e11c8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Getting quotas for project b5da9e76bed44f3d90144e4fbff2cb1c. Resources: {'ram', 'instances', 'cores'} {{(pid=120709) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:35.782962 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.quota [None req-504cf076-7852-4da6-90e1-22298d9e11c8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Getting quotas for user 1af20de2433c44ff8fb1f16290404c21 and project b5da9e76bed44f3d90144e4fbff2cb1c. Resources: {'ram', 'instances', 'cores'} {{(pid=120709) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:35.801172 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-504cf076-7852-4da6-90e1-22298d9e11c8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Going to run 1 instances... {{(pid=120709) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:31:35.803521 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-504cf076-7852-4da6-90e1-22298d9e11c8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b7a40f0c-20c2-44cd-8b0e-f6e73a007d3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120709) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:31:35.839644 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-62a3e7ed-e8ea-4f1b-b691-9d51a5358357 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:35.840298 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-62a3e7ed-e8ea-4f1b-b691-9d51a5358357 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 40fde0c1-f011-4e1b-a4fa-cecb0d44132b] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:35.860908 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-504cf076-7852-4da6-90e1-22298d9e11c8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.694243 Aug 24 03:31:35.862399 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-62a3e7ed-e8ea-4f1b-b691-9d51a5358357 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:35.862546 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 96/182] 10.222.0.81 () {62 vars in 1188 bytes} [Wed Aug 24 03:31:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 03:31:35.863238 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-62a3e7ed-e8ea-4f1b-b691-9d51a5358357 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:35.863852 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-62a3e7ed-e8ea-4f1b-b691-9d51a5358357 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:35.864836 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-62a3e7ed-e8ea-4f1b-b691-9d51a5358357 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:35.865420 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-62a3e7ed-e8ea-4f1b-b691-9d51a5358357 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:35.866029 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-62a3e7ed-e8ea-4f1b-b691-9d51a5358357 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:35.867689 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-a6ee6862-ce85-40f6-af81-9c99b6846bb5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:35.868496 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-a6ee6862-ce85-40f6-af81-9c99b6846bb5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:35.881615 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a6ee6862-ce85-40f6-af81-9c99b6846bb5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:35.882372 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a6ee6862-ce85-40f6-af81-9c99b6846bb5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:35.883064 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a6ee6862-ce85-40f6-af81-9c99b6846bb5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:35.883934 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a6ee6862-ce85-40f6-af81-9c99b6846bb5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:35.884604 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a6ee6862-ce85-40f6-af81-9c99b6846bb5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:35.885294 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a6ee6862-ce85-40f6-af81-9c99b6846bb5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:36.122218 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-62a3e7ed-e8ea-4f1b-b691-9d51a5358357 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a2e4acb9f4eab98f96e3fa3001099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82c6dd205d640a4a78c23050a8f73af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:36.133517 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-62a3e7ed-e8ea-4f1b-b691-9d51a5358357 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b" status: 200 len: 1313 microversion: 2.1 time: 0.298302 Aug 24 03:31:36.135105 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 87/183] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:35 2022] GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:36.142784 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-72570f42-6b42-4aea-86de-1035f790ffa3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:36.143455 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-72570f42-6b42-4aea-86de-1035f790ffa3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:36.166861 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-a6ee6862-ce85-40f6-af81-9c99b6846bb5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:36.181361 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-a6ee6862-ce85-40f6-af81-9c99b6846bb5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1523 microversion: 2.1 time: 0.317265 Aug 24 03:31:36.182233 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 97/184] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:35 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1523 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:36.228718 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-72570f42-6b42-4aea-86de-1035f790ffa3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:36.237095 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-72570f42-6b42-4aea-86de-1035f790ffa3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:36.238814 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-72570f42-6b42-4aea-86de-1035f790ffa3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:36.240533 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-72570f42-6b42-4aea-86de-1035f790ffa3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1280 microversion: 2.20 time: 0.103923 Aug 24 03:31:36.241121 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 88/185] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:36 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1280 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:37.156690 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-b79370b1-8975-48d9-84f7-fec6a4cff714 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:37.157364 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-b79370b1-8975-48d9-84f7-fec6a4cff714 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 40fde0c1-f011-4e1b-a4fa-cecb0d44132b] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:37.163606 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b79370b1-8975-48d9-84f7-fec6a4cff714 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:37.164098 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b79370b1-8975-48d9-84f7-fec6a4cff714 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:37.164537 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b79370b1-8975-48d9-84f7-fec6a4cff714 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:37.165274 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b79370b1-8975-48d9-84f7-fec6a4cff714 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:37.165730 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b79370b1-8975-48d9-84f7-fec6a4cff714 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:37.166157 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b79370b1-8975-48d9-84f7-fec6a4cff714 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:37.203614 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-dd02a880-c126-4afe-9ec4-2e585b048b12 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:37.205606 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-dd02a880-c126-4afe-9ec4-2e585b048b12 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:37.211853 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=2 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:37.214511 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dd02a880-c126-4afe-9ec4-2e585b048b12 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:37.215003 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dd02a880-c126-4afe-9ec4-2e585b048b12 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:37.215435 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dd02a880-c126-4afe-9ec4-2e585b048b12 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:37.216385 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dd02a880-c126-4afe-9ec4-2e585b048b12 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:37.217721 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dd02a880-c126-4afe-9ec4-2e585b048b12 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:37.218416 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dd02a880-c126-4afe-9ec4-2e585b048b12 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:37.429569 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-b79370b1-8975-48d9-84f7-fec6a4cff714 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a2e4acb9f4eab98f96e3fa3001099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82c6dd205d640a4a78c23050a8f73af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:37.437327 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-dd02a880-c126-4afe-9ec4-2e585b048b12 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:37.441766 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-b79370b1-8975-48d9-84f7-fec6a4cff714 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b" status: 200 len: 1313 microversion: 2.1 time: 0.289433 Aug 24 03:31:37.443809 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 98/186] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:37 2022] GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:37.446613 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-dd02a880-c126-4afe-9ec4-2e585b048b12 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1523 microversion: 2.1 time: 0.246811 Aug 24 03:31:37.447448 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 89/187] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:37 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1523 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:31:37.450206 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-d8d29c1c-4bb5-4c55-bf36-a92b131c3569 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:37.453197 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-d8d29c1c-4bb5-4c55-bf36-a92b131c3569 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:37.461940 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d8d29c1c-4bb5-4c55-bf36-a92b131c3569 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:37.463310 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d8d29c1c-4bb5-4c55-bf36-a92b131c3569 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:37.464140 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d8d29c1c-4bb5-4c55-bf36-a92b131c3569 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:37.465095 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d8d29c1c-4bb5-4c55-bf36-a92b131c3569 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:37.465920 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d8d29c1c-4bb5-4c55-bf36-a92b131c3569 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:37.467539 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d8d29c1c-4bb5-4c55-bf36-a92b131c3569 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:37.574109 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-d8d29c1c-4bb5-4c55-bf36-a92b131c3569 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:37.588984 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-d8d29c1c-4bb5-4c55-bf36-a92b131c3569 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:37.591297 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-d8d29c1c-4bb5-4c55-bf36-a92b131c3569 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:37.593194 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-d8d29c1c-4bb5-4c55-bf36-a92b131c3569 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1340 microversion: 2.20 time: 0.147143 Aug 24 03:31:37.594423 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 99/188] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:37 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1340 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:38.477966 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f05b7919-4645-401e-a1d1-000c0e21fe35 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:38.479414 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f05b7919-4645-401e-a1d1-000c0e21fe35 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 40fde0c1-f011-4e1b-a4fa-cecb0d44132b] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:38.482627 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-fc894e01-e190-49e7-8122-ab4f133e88c0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:38.485484 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-fc894e01-e190-49e7-8122-ab4f133e88c0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:38.490883 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f05b7919-4645-401e-a1d1-000c0e21fe35 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:38.491725 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f05b7919-4645-401e-a1d1-000c0e21fe35 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:38.492358 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f05b7919-4645-401e-a1d1-000c0e21fe35 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:38.492508 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:38.494498 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f05b7919-4645-401e-a1d1-000c0e21fe35 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:38.494722 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fc894e01-e190-49e7-8122-ab4f133e88c0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:38.495454 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f05b7919-4645-401e-a1d1-000c0e21fe35 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:38.495574 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fc894e01-e190-49e7-8122-ab4f133e88c0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:38.496116 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fc894e01-e190-49e7-8122-ab4f133e88c0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:38.496732 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f05b7919-4645-401e-a1d1-000c0e21fe35 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:38.496911 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fc894e01-e190-49e7-8122-ab4f133e88c0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:38.497807 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fc894e01-e190-49e7-8122-ab4f133e88c0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:38.499437 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fc894e01-e190-49e7-8122-ab4f133e88c0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:39.032913 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-fc894e01-e190-49e7-8122-ab4f133e88c0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:39.042982 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f05b7919-4645-401e-a1d1-000c0e21fe35 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a2e4acb9f4eab98f96e3fa3001099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82c6dd205d640a4a78c23050a8f73af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:39.044881 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-fc894e01-e190-49e7-8122-ab4f133e88c0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1523 microversion: 2.1 time: 0.566521 Aug 24 03:31:39.046135 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 100/189] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:38 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1523 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:31:39.057088 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-aba033f6-1bb9-4843-9382-15a358d647d1 req-c4b37fc2-df32-413b-87d0-6027c71c6c61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40fde0c1-f011-4e1b-a4fa-cecb0d44132b", "name": "network-vif-plugged", "status": "completed", "tag": "2e9d914d-9e52-489f-bd3b-ace15db6dd1d"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:39.062653 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-aba033f6-1bb9-4843-9382-15a358d647d1 req-c4b37fc2-df32-413b-87d0-6027c71c6c61 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:39.063475 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-aba033f6-1bb9-4843-9382-15a358d647d1 req-c4b37fc2-df32-413b-87d0-6027c71c6c61 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:39.064259 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-aba033f6-1bb9-4843-9382-15a358d647d1 req-c4b37fc2-df32-413b-87d0-6027c71c6c61 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:39.068573 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f05b7919-4645-401e-a1d1-000c0e21fe35 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b" status: 200 len: 1313 microversion: 2.1 time: 0.594869 Aug 24 03:31:39.069975 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 90/190] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:38 2022] GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b => generated 1313 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:39.080206 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-be4071bd-b0f9-4664-b125-a5ea6617c3cc tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:39.081034 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-be4071bd-b0f9-4664-b125-a5ea6617c3cc tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:39.087585 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-be4071bd-b0f9-4664-b125-a5ea6617c3cc tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:39.088748 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-be4071bd-b0f9-4664-b125-a5ea6617c3cc tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:39.089253 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-be4071bd-b0f9-4664-b125-a5ea6617c3cc tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:39.090132 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-be4071bd-b0f9-4664-b125-a5ea6617c3cc tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:39.090290 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-aba033f6-1bb9-4843-9382-15a358d647d1 req-c4b37fc2-df32-413b-87d0-6027c71c6c61 service nova] Creating event network-vif-plugged:2e9d914d-9e52-489f-bd3b-ace15db6dd1d for instance 40fde0c1-f011-4e1b-a4fa-cecb0d44132b on hv-cinder-85426 Aug 24 03:31:39.090589 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-be4071bd-b0f9-4664-b125-a5ea6617c3cc tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:39.091016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-be4071bd-b0f9-4664-b125-a5ea6617c3cc tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:39.096600 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-aba033f6-1bb9-4843-9382-15a358d647d1 req-c4b37fc2-df32-413b-87d0-6027c71c6c61 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048894 Aug 24 03:31:39.097679 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 101/191] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:39.396994 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-be4071bd-b0f9-4664-b125-a5ea6617c3cc tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:39.403217 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-be4071bd-b0f9-4664-b125-a5ea6617c3cc tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:39.405242 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-be4071bd-b0f9-4664-b125-a5ea6617c3cc tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:39.407436 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-be4071bd-b0f9-4664-b125-a5ea6617c3cc tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1405 microversion: 2.20 time: 0.335283 Aug 24 03:31:39.420351 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 91/192] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:39 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1405 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:39.758166 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-fb718c34-48a2-4e9b-9c54-7cc92ef99460 req-9fbada60-0dc6-43e3-9715-b264ea946998 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a89effc-2ad4-414e-bca5-d503b48fb040", "tag": "57289a66-609a-46ea-b8c8-5258bbaf0864"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:39.769676 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-fb718c34-48a2-4e9b-9c54-7cc92ef99460 req-9fbada60-0dc6-43e3-9715-b264ea946998 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:39.770312 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-fb718c34-48a2-4e9b-9c54-7cc92ef99460 req-9fbada60-0dc6-43e3-9715-b264ea946998 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:39.771077 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-fb718c34-48a2-4e9b-9c54-7cc92ef99460 req-9fbada60-0dc6-43e3-9715-b264ea946998 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:39.784350 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-fb718c34-48a2-4e9b-9c54-7cc92ef99460 req-9fbada60-0dc6-43e3-9715-b264ea946998 service nova] Creating event network-changed:57289a66-609a-46ea-b8c8-5258bbaf0864 for instance 4a89effc-2ad4-414e-bca5-d503b48fb040 on hv-cinder-85426 Aug 24 03:31:39.789606 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-fb718c34-48a2-4e9b-9c54-7cc92ef99460 req-9fbada60-0dc6-43e3-9715-b264ea946998 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035750 Aug 24 03:31:39.790800 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 102/193] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:40.069285 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-537cf65f-1a27-4163-85ec-41f230e76b33 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:40.070007 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-537cf65f-1a27-4163-85ec-41f230e76b33 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:40.076362 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-537cf65f-1a27-4163-85ec-41f230e76b33 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:40.077632 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-537cf65f-1a27-4163-85ec-41f230e76b33 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:40.078016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-537cf65f-1a27-4163-85ec-41f230e76b33 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:40.078762 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-537cf65f-1a27-4163-85ec-41f230e76b33 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:40.079213 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-537cf65f-1a27-4163-85ec-41f230e76b33 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:40.079698 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-537cf65f-1a27-4163-85ec-41f230e76b33 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:40.094134 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-5fbcf399-f096-4fcf-8636-ea463a65dff9 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:40.095072 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-5fbcf399-f096-4fcf-8636-ea463a65dff9 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 40fde0c1-f011-4e1b-a4fa-cecb0d44132b] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:40.101753 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5fbcf399-f096-4fcf-8636-ea463a65dff9 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:40.102244 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5fbcf399-f096-4fcf-8636-ea463a65dff9 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:40.102688 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5fbcf399-f096-4fcf-8636-ea463a65dff9 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:40.103444 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5fbcf399-f096-4fcf-8636-ea463a65dff9 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:40.103902 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5fbcf399-f096-4fcf-8636-ea463a65dff9 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:40.104351 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5fbcf399-f096-4fcf-8636-ea463a65dff9 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:40.305326 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-537cf65f-1a27-4163-85ec-41f230e76b33 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:40.309682 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-5fbcf399-f096-4fcf-8636-ea463a65dff9 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a2e4acb9f4eab98f96e3fa3001099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82c6dd205d640a4a78c23050a8f73af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:40.313268 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-537cf65f-1a27-4163-85ec-41f230e76b33 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1523 microversion: 2.1 time: 0.247741 Aug 24 03:31:40.313885 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 92/194] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:40 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1523 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:40.318308 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-5fbcf399-f096-4fcf-8636-ea463a65dff9 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b" status: 200 len: 1313 microversion: 2.1 time: 0.228790 Aug 24 03:31:40.318868 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 103/195] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:40 2022] GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:31:40.430675 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-9729ab5d-d70e-4959-897b-29167d68602c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:40.431937 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-9729ab5d-d70e-4959-897b-29167d68602c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:40.439519 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9729ab5d-d70e-4959-897b-29167d68602c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:40.440005 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9729ab5d-d70e-4959-897b-29167d68602c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:40.440621 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9729ab5d-d70e-4959-897b-29167d68602c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:40.441360 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9729ab5d-d70e-4959-897b-29167d68602c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:40.442070 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9729ab5d-d70e-4959-897b-29167d68602c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:40.442541 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9729ab5d-d70e-4959-897b-29167d68602c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:40.590362 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-9729ab5d-d70e-4959-897b-29167d68602c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:40.600206 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-9729ab5d-d70e-4959-897b-29167d68602c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:40.602047 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-9729ab5d-d70e-4959-897b-29167d68602c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:40.603239 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-9729ab5d-d70e-4959-897b-29167d68602c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1405 microversion: 2.20 time: 0.177131 Aug 24 03:31:40.603872 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 93/196] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:40 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:41.335479 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-770c68ab-ce43-4927-88f8-9247e39f7eae tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:41.336035 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-770c68ab-ce43-4927-88f8-9247e39f7eae tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:41.339227 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-cbd053bc-6850-4dcf-a01a-b7168363851e tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:41.339841 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-cbd053bc-6850-4dcf-a01a-b7168363851e tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 40fde0c1-f011-4e1b-a4fa-cecb0d44132b] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:41.341983 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-770c68ab-ce43-4927-88f8-9247e39f7eae tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:41.343142 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-770c68ab-ce43-4927-88f8-9247e39f7eae tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:41.344015 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-770c68ab-ce43-4927-88f8-9247e39f7eae tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:41.344242 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-770c68ab-ce43-4927-88f8-9247e39f7eae tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:41.344688 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-770c68ab-ce43-4927-88f8-9247e39f7eae tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:41.345130 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-770c68ab-ce43-4927-88f8-9247e39f7eae tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:41.347102 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cbd053bc-6850-4dcf-a01a-b7168363851e tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:41.347589 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cbd053bc-6850-4dcf-a01a-b7168363851e tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:41.348029 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cbd053bc-6850-4dcf-a01a-b7168363851e tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:41.348721 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cbd053bc-6850-4dcf-a01a-b7168363851e tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:41.349231 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cbd053bc-6850-4dcf-a01a-b7168363851e tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:41.349665 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cbd053bc-6850-4dcf-a01a-b7168363851e tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:41.364349 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=100 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:41.545196 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-770c68ab-ce43-4927-88f8-9247e39f7eae tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:41.548798 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-cbd053bc-6850-4dcf-a01a-b7168363851e tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a2e4acb9f4eab98f96e3fa3001099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82c6dd205d640a4a78c23050a8f73af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:41.559041 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-cbd053bc-6850-4dcf-a01a-b7168363851e tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b" status: 200 len: 1313 microversion: 2.1 time: 0.223473 Aug 24 03:31:41.559709 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 94/197] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:41 2022] GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:31:41.565213 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-770c68ab-ce43-4927-88f8-9247e39f7eae tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1503 microversion: 2.1 time: 0.233876 Aug 24 03:31:41.565781 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 104/198] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:41 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1503 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:41.586781 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7bb2aadb-bf37-458c-8e8f-4920f355faa9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:41.587335 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-7bb2aadb-bf37-458c-8e8f-4920f355faa9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:41.593408 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7bb2aadb-bf37-458c-8e8f-4920f355faa9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:41.593889 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7bb2aadb-bf37-458c-8e8f-4920f355faa9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:41.594325 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7bb2aadb-bf37-458c-8e8f-4920f355faa9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:41.595011 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7bb2aadb-bf37-458c-8e8f-4920f355faa9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:41.595469 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7bb2aadb-bf37-458c-8e8f-4920f355faa9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:41.595896 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7bb2aadb-bf37-458c-8e8f-4920f355faa9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:41.627357 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-d6b16269-3516-4d31-85af-29e571d54c12 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:41.628231 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-d6b16269-3516-4d31-85af-29e571d54c12 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:41.634762 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d6b16269-3516-4d31-85af-29e571d54c12 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:41.635429 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d6b16269-3516-4d31-85af-29e571d54c12 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:41.635858 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d6b16269-3516-4d31-85af-29e571d54c12 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:41.636552 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d6b16269-3516-4d31-85af-29e571d54c12 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:41.637021 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d6b16269-3516-4d31-85af-29e571d54c12 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:41.637440 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d6b16269-3516-4d31-85af-29e571d54c12 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:41.787727 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-7bb2aadb-bf37-458c-8e8f-4920f355faa9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:41.799567 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-7bb2aadb-bf37-458c-8e8f-4920f355faa9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1516 microversion: 2.1 time: 0.216699 Aug 24 03:31:41.800401 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 95/199] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:41 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1516 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:41.845332 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-d6b16269-3516-4d31-85af-29e571d54c12 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:41.859378 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-d6b16269-3516-4d31-85af-29e571d54c12 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:41.861127 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-d6b16269-3516-4d31-85af-29e571d54c12 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:41.862958 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-d6b16269-3516-4d31-85af-29e571d54c12 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1405 microversion: 2.20 time: 0.239900 Aug 24 03:31:41.880738 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 105/200] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:41 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1405 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:31:42.583357 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-28f65811-7b75-4c65-ac8f-dbe84d44d723 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:42.583966 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-28f65811-7b75-4c65-ac8f-dbe84d44d723 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 40fde0c1-f011-4e1b-a4fa-cecb0d44132b] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:42.590097 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-28f65811-7b75-4c65-ac8f-dbe84d44d723 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:42.590988 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-28f65811-7b75-4c65-ac8f-dbe84d44d723 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:42.591582 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-28f65811-7b75-4c65-ac8f-dbe84d44d723 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:42.592430 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-28f65811-7b75-4c65-ac8f-dbe84d44d723 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:42.593059 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-28f65811-7b75-4c65-ac8f-dbe84d44d723 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:42.593624 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-28f65811-7b75-4c65-ac8f-dbe84d44d723 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:42.804430 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-28f65811-7b75-4c65-ac8f-dbe84d44d723 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a2e4acb9f4eab98f96e3fa3001099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82c6dd205d640a4a78c23050a8f73af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:42.816723 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-28f65811-7b75-4c65-ac8f-dbe84d44d723 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b" status: 200 len: 1496 microversion: 2.1 time: 0.237070 Aug 24 03:31:42.828798 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 96/201] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:42 2022] GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b => generated 1496 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:42.887734 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-d47553d2-056f-4699-ae24-ff5689aefacf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:42.888261 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-d47553d2-056f-4699-ae24-ff5689aefacf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:42.906316 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d47553d2-056f-4699-ae24-ff5689aefacf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:42.906812 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d47553d2-056f-4699-ae24-ff5689aefacf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:42.907244 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d47553d2-056f-4699-ae24-ff5689aefacf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:42.907951 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d47553d2-056f-4699-ae24-ff5689aefacf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:42.908406 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d47553d2-056f-4699-ae24-ff5689aefacf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:42.908855 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d47553d2-056f-4699-ae24-ff5689aefacf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:43.096907 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-d47553d2-056f-4699-ae24-ff5689aefacf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:43.114087 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-d47553d2-056f-4699-ae24-ff5689aefacf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:43.116086 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-d47553d2-056f-4699-ae24-ff5689aefacf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:43.132194 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-d47553d2-056f-4699-ae24-ff5689aefacf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1405 microversion: 2.20 time: 0.248149 Aug 24 03:31:43.141293 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 106/202] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:42 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1405 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:43.338604 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-601da528-3b6a-47e5-bcc2-09639aa125bc tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:43.340960 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-601da528-3b6a-47e5-bcc2-09639aa125bc tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:43.347646 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-601da528-3b6a-47e5-bcc2-09639aa125bc tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:43.348141 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-601da528-3b6a-47e5-bcc2-09639aa125bc tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:43.348581 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-601da528-3b6a-47e5-bcc2-09639aa125bc tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:43.349311 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-601da528-3b6a-47e5-bcc2-09639aa125bc tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:43.349776 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-601da528-3b6a-47e5-bcc2-09639aa125bc tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:43.350198 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-601da528-3b6a-47e5-bcc2-09639aa125bc tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:43.378319 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.objects.instance [None req-601da528-3b6a-47e5-bcc2-09639aa125bc tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lazy-loading 'flavor' on Instance uuid a844487d-f9fc-4452-843d-d6ac2efb35d6 {{(pid=120708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:31:43.511708 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-f7f321a3-e474-43c5-a3e1-30faf039705f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:43.512549 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-f7f321a3-e474-43c5-a3e1-30faf039705f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 40fde0c1-f011-4e1b-a4fa-cecb0d44132b] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:43.520830 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f7f321a3-e474-43c5-a3e1-30faf039705f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:43.521548 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f7f321a3-e474-43c5-a3e1-30faf039705f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:43.522948 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f7f321a3-e474-43c5-a3e1-30faf039705f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:43.523993 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f7f321a3-e474-43c5-a3e1-30faf039705f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:43.524759 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f7f321a3-e474-43c5-a3e1-30faf039705f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:43.525462 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f7f321a3-e474-43c5-a3e1-30faf039705f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:43.555761 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-601da528-3b6a-47e5-bcc2-09639aa125bc tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "POST /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6/action" status: 200 len: 32 microversion: 2.1 time: 0.221291 Aug 24 03:31:43.556627 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 97/203] 10.222.0.81 () {60 vars in 1278 bytes} [Wed Aug 24 03:31:43 2022] POST /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6/action => generated 32 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:31:43.558255 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-f7f321a3-e474-43c5-a3e1-30faf039705f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 40fde0c1-f011-4e1b-a4fa-cecb0d44132b] Going to try to terminate instance {{(pid=120709) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:31:43.569301 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7fe33a45-d35d-43cc-b5c5-48d479196452 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:43.570182 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-7fe33a45-d35d-43cc-b5c5-48d479196452 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:43.579220 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7fe33a45-d35d-43cc-b5c5-48d479196452 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:43.580066 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7fe33a45-d35d-43cc-b5c5-48d479196452 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:43.580870 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7fe33a45-d35d-43cc-b5c5-48d479196452 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:43.582178 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7fe33a45-d35d-43cc-b5c5-48d479196452 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:43.582838 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7fe33a45-d35d-43cc-b5c5-48d479196452 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:43.583532 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7fe33a45-d35d-43cc-b5c5-48d479196452 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:43.699387 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-f7f321a3-e474-43c5-a3e1-30faf039705f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "DELETE /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b" status: 204 len: 0 microversion: 2.1 time: 0.191164 Aug 24 03:31:43.700305 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 107/204] 10.222.0.81 () {58 vars in 1239 bytes} [Wed Aug 24 03:31:43 2022] DELETE /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:31:43.709099 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-fd12fc20-4b03-4327-b748-f5b5465a6f95 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:43.709793 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-fd12fc20-4b03-4327-b748-f5b5465a6f95 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 40fde0c1-f011-4e1b-a4fa-cecb0d44132b] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:43.715761 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fd12fc20-4b03-4327-b748-f5b5465a6f95 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:43.716239 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fd12fc20-4b03-4327-b748-f5b5465a6f95 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:43.716668 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fd12fc20-4b03-4327-b748-f5b5465a6f95 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:43.717402 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fd12fc20-4b03-4327-b748-f5b5465a6f95 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:43.718498 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fd12fc20-4b03-4327-b748-f5b5465a6f95 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:43.720068 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fd12fc20-4b03-4327-b748-f5b5465a6f95 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:43.838368 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-7fe33a45-d35d-43cc-b5c5-48d479196452 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:43.847411 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-7fe33a45-d35d-43cc-b5c5-48d479196452 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1522 microversion: 2.1 time: 0.283990 Aug 24 03:31:43.848323 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 98/205] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:43 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:43.899001 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-fd12fc20-4b03-4327-b748-f5b5465a6f95 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a2e4acb9f4eab98f96e3fa3001099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82c6dd205d640a4a78c23050a8f73af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:43.907678 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-fd12fc20-4b03-4327-b748-f5b5465a6f95 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b" status: 200 len: 1502 microversion: 2.1 time: 0.202527 Aug 24 03:31:43.908275 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 108/206] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:43 2022] GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b => generated 1502 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:31:44.160052 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a89a3125-7b16-4845-aaab-9f7f084d3d77 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:44.160660 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a89a3125-7b16-4845-aaab-9f7f084d3d77 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:44.166656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a89a3125-7b16-4845-aaab-9f7f084d3d77 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:44.167143 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a89a3125-7b16-4845-aaab-9f7f084d3d77 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:44.167868 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a89a3125-7b16-4845-aaab-9f7f084d3d77 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:44.168260 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a89a3125-7b16-4845-aaab-9f7f084d3d77 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:44.168712 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a89a3125-7b16-4845-aaab-9f7f084d3d77 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:44.169189 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a89a3125-7b16-4845-aaab-9f7f084d3d77 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:44.310226 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a89a3125-7b16-4845-aaab-9f7f084d3d77 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:44.318900 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a89a3125-7b16-4845-aaab-9f7f084d3d77 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:44.320503 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a89a3125-7b16-4845-aaab-9f7f084d3d77 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:44.321647 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a89a3125-7b16-4845-aaab-9f7f084d3d77 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1405 microversion: 2.20 time: 0.166086 Aug 24 03:31:44.322211 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 99/207] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:44 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:44.871247 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-0982d85c-c859-4415-8ac0-0365b7c466d7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:44.872397 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-0982d85c-c859-4415-8ac0-0365b7c466d7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:44.882134 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0982d85c-c859-4415-8ac0-0365b7c466d7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:44.882874 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0982d85c-c859-4415-8ac0-0365b7c466d7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:44.883572 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0982d85c-c859-4415-8ac0-0365b7c466d7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:44.884635 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0982d85c-c859-4415-8ac0-0365b7c466d7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:44.885370 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0982d85c-c859-4415-8ac0-0365b7c466d7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:44.886035 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0982d85c-c859-4415-8ac0-0365b7c466d7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:44.928992 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-70da48df-f8ab-43fa-abde-2e42df8cca37 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:44.929615 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-70da48df-f8ab-43fa-abde-2e42df8cca37 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 40fde0c1-f011-4e1b-a4fa-cecb0d44132b] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:44.937145 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-70da48df-f8ab-43fa-abde-2e42df8cca37 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:44.937762 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-70da48df-f8ab-43fa-abde-2e42df8cca37 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:44.938216 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-70da48df-f8ab-43fa-abde-2e42df8cca37 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:44.938902 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-70da48df-f8ab-43fa-abde-2e42df8cca37 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:44.939543 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-70da48df-f8ab-43fa-abde-2e42df8cca37 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:44.940275 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-70da48df-f8ab-43fa-abde-2e42df8cca37 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:45.058681 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-0982d85c-c859-4415-8ac0-0365b7c466d7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:45.067951 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-0982d85c-c859-4415-8ac0-0365b7c466d7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1522 microversion: 2.1 time: 0.202489 Aug 24 03:31:45.068531 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 109/208] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:44 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:45.146307 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-70da48df-f8ab-43fa-abde-2e42df8cca37 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a2e4acb9f4eab98f96e3fa3001099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82c6dd205d640a4a78c23050a8f73af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:45.155738 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-70da48df-f8ab-43fa-abde-2e42df8cca37 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b" status: 200 len: 1502 microversion: 2.1 time: 0.229959 Aug 24 03:31:45.156422 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 100/209] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:44 2022] GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b => generated 1502 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:31:45.344863 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-35c19ef6-cb7e-43b0-8de4-42b415ccfa2e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:45.345668 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-35c19ef6-cb7e-43b0-8de4-42b415ccfa2e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:45.351735 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-35c19ef6-cb7e-43b0-8de4-42b415ccfa2e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:45.352312 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-35c19ef6-cb7e-43b0-8de4-42b415ccfa2e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:45.352851 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-35c19ef6-cb7e-43b0-8de4-42b415ccfa2e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:45.353614 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-35c19ef6-cb7e-43b0-8de4-42b415ccfa2e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:45.354238 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-35c19ef6-cb7e-43b0-8de4-42b415ccfa2e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:45.354664 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-35c19ef6-cb7e-43b0-8de4-42b415ccfa2e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:45.495158 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-35c19ef6-cb7e-43b0-8de4-42b415ccfa2e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:45.504434 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-35c19ef6-cb7e-43b0-8de4-42b415ccfa2e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:45.506301 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-35c19ef6-cb7e-43b0-8de4-42b415ccfa2e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:45.507490 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-35c19ef6-cb7e-43b0-8de4-42b415ccfa2e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1405 microversion: 2.20 time: 0.167917 Aug 24 03:31:45.508124 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 110/210] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:45 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:46.089101 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0a4be25e-4958-465b-ab5a-2f2fb88bf836 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:46.089731 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0a4be25e-4958-465b-ab5a-2f2fb88bf836 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:46.096206 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0a4be25e-4958-465b-ab5a-2f2fb88bf836 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:46.096690 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0a4be25e-4958-465b-ab5a-2f2fb88bf836 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:46.097185 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0a4be25e-4958-465b-ab5a-2f2fb88bf836 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:46.097876 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0a4be25e-4958-465b-ab5a-2f2fb88bf836 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:46.098318 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0a4be25e-4958-465b-ab5a-2f2fb88bf836 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:46.098738 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0a4be25e-4958-465b-ab5a-2f2fb88bf836 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:46.177527 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-c00787ec-4d36-4d75-9a7a-47eb87ebb5b3 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:46.178084 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-c00787ec-4d36-4d75-9a7a-47eb87ebb5b3 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 40fde0c1-f011-4e1b-a4fa-cecb0d44132b] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:46.180355 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell0:SELECT=2 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:46.181133 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell0:SELECT=12 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:46.189838 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c00787ec-4d36-4d75-9a7a-47eb87ebb5b3 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:46.190336 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c00787ec-4d36-4d75-9a7a-47eb87ebb5b3 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:46.190806 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c00787ec-4d36-4d75-9a7a-47eb87ebb5b3 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:46.191509 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c00787ec-4d36-4d75-9a7a-47eb87ebb5b3 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:46.191958 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c00787ec-4d36-4d75-9a7a-47eb87ebb5b3 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:46.192377 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c00787ec-4d36-4d75-9a7a-47eb87ebb5b3 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:46.210048 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:46.234869 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0a4be25e-4958-465b-ab5a-2f2fb88bf836 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:46.238411 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=8 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:46.246546 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0a4be25e-4958-465b-ab5a-2f2fb88bf836 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1522 microversion: 2.1 time: 0.161330 Aug 24 03:31:46.247803 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 101/211] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:46 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:46.343432 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-c00787ec-4d36-4d75-9a7a-47eb87ebb5b3 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a2e4acb9f4eab98f96e3fa3001099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82c6dd205d640a4a78c23050a8f73af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:46.353829 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-c00787ec-4d36-4d75-9a7a-47eb87ebb5b3 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b" status: 200 len: 1502 microversion: 2.1 time: 0.179994 Aug 24 03:31:46.365982 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 111/212] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:46 2022] GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b => generated 1502 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:31:46.532801 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f9bf76ac-bb40-4231-b52b-3ba67555dff7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:46.533340 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f9bf76ac-bb40-4231-b52b-3ba67555dff7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:46.539286 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f9bf76ac-bb40-4231-b52b-3ba67555dff7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:46.539773 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f9bf76ac-bb40-4231-b52b-3ba67555dff7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:46.540206 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f9bf76ac-bb40-4231-b52b-3ba67555dff7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:46.541108 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f9bf76ac-bb40-4231-b52b-3ba67555dff7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:46.541564 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f9bf76ac-bb40-4231-b52b-3ba67555dff7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:46.542164 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f9bf76ac-bb40-4231-b52b-3ba67555dff7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:46.704026 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f9bf76ac-bb40-4231-b52b-3ba67555dff7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:46.714411 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f9bf76ac-bb40-4231-b52b-3ba67555dff7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:46.716669 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f9bf76ac-bb40-4231-b52b-3ba67555dff7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:46.718035 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f9bf76ac-bb40-4231-b52b-3ba67555dff7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1405 microversion: 2.20 time: 0.190483 Aug 24 03:31:46.719264 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 102/213] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:46 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1405 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:47.269429 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-a60cef3e-ef62-48c9-b7a7-e69e5b08c830 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:47.270036 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-a60cef3e-ef62-48c9-b7a7-e69e5b08c830 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:47.276134 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a60cef3e-ef62-48c9-b7a7-e69e5b08c830 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:47.276625 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a60cef3e-ef62-48c9-b7a7-e69e5b08c830 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:47.278602 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a60cef3e-ef62-48c9-b7a7-e69e5b08c830 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:47.278602 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a60cef3e-ef62-48c9-b7a7-e69e5b08c830 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:47.278602 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a60cef3e-ef62-48c9-b7a7-e69e5b08c830 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:47.278865 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a60cef3e-ef62-48c9-b7a7-e69e5b08c830 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:47.380359 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7a33cc07-3bb1-4f14-ad5b-9617ddc4abe3 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:47.381015 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-7a33cc07-3bb1-4f14-ad5b-9617ddc4abe3 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 40fde0c1-f011-4e1b-a4fa-cecb0d44132b] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:47.383526 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:47.388937 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7a33cc07-3bb1-4f14-ad5b-9617ddc4abe3 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:47.389471 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7a33cc07-3bb1-4f14-ad5b-9617ddc4abe3 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:47.390529 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7a33cc07-3bb1-4f14-ad5b-9617ddc4abe3 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:47.391247 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7a33cc07-3bb1-4f14-ad5b-9617ddc4abe3 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:47.391767 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7a33cc07-3bb1-4f14-ad5b-9617ddc4abe3 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:47.392190 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7a33cc07-3bb1-4f14-ad5b-9617ddc4abe3 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:47.483098 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-7a33cc07-3bb1-4f14-ad5b-9617ddc4abe3 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a2e4acb9f4eab98f96e3fa3001099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82c6dd205d640a4a78c23050a8f73af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:47.491435 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-7a33cc07-3bb1-4f14-ad5b-9617ddc4abe3 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b" status: 200 len: 1460 microversion: 2.1 time: 0.117389 Aug 24 03:31:47.492003 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 103/214] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:47 2022] GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b => generated 1460 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:31:47.511051 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-7a76cb86-555c-4269-9c7d-f96d47d0415d req-1fba6dc9-7354-431b-933d-aa4f6732f9da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40fde0c1-f011-4e1b-a4fa-cecb0d44132b", "name": "network-vif-deleted", "tag": "2e9d914d-9e52-489f-bd3b-ace15db6dd1d"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:47.521732 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-7a76cb86-555c-4269-9c7d-f96d47d0415d req-1fba6dc9-7354-431b-933d-aa4f6732f9da service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:47.522243 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-7a76cb86-555c-4269-9c7d-f96d47d0415d req-1fba6dc9-7354-431b-933d-aa4f6732f9da service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:47.522698 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-7a76cb86-555c-4269-9c7d-f96d47d0415d req-1fba6dc9-7354-431b-933d-aa4f6732f9da service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:47.533478 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-a60cef3e-ef62-48c9-b7a7-e69e5b08c830 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:47.535668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-7a76cb86-555c-4269-9c7d-f96d47d0415d req-1fba6dc9-7354-431b-933d-aa4f6732f9da service nova] Creating event network-vif-deleted:2e9d914d-9e52-489f-bd3b-ace15db6dd1d for instance 40fde0c1-f011-4e1b-a4fa-cecb0d44132b on hv-cinder-85426 Aug 24 03:31:47.540375 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-7a76cb86-555c-4269-9c7d-f96d47d0415d req-1fba6dc9-7354-431b-933d-aa4f6732f9da service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034063 Aug 24 03:31:47.541026 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 104/215] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:47.542121 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-a60cef3e-ef62-48c9-b7a7-e69e5b08c830 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1522 microversion: 2.1 time: 0.277092 Aug 24 03:31:47.543032 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 112/216] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:47 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:31:47.741552 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-13c9b956-5bce-4ab5-a7e1-7301109b975a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:47.742302 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-13c9b956-5bce-4ab5-a7e1-7301109b975a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:47.748561 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-13c9b956-5bce-4ab5-a7e1-7301109b975a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:47.749889 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-13c9b956-5bce-4ab5-a7e1-7301109b975a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:47.750755 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-13c9b956-5bce-4ab5-a7e1-7301109b975a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:47.751444 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-13c9b956-5bce-4ab5-a7e1-7301109b975a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:47.751896 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-13c9b956-5bce-4ab5-a7e1-7301109b975a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:47.752317 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-13c9b956-5bce-4ab5-a7e1-7301109b975a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:47.901294 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-13c9b956-5bce-4ab5-a7e1-7301109b975a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:47.911469 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-13c9b956-5bce-4ab5-a7e1-7301109b975a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:47.916644 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-13c9b956-5bce-4ab5-a7e1-7301109b975a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:47.918279 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-13c9b956-5bce-4ab5-a7e1-7301109b975a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1405 microversion: 2.20 time: 0.180920 Aug 24 03:31:47.919356 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 105/217] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:47 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1405 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:48.517523 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-b2de148d-a76d-4436-97fe-86095c69b465 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:48.518632 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-b2de148d-a76d-4436-97fe-86095c69b465 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 40fde0c1-f011-4e1b-a4fa-cecb0d44132b] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:48.525342 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b2de148d-a76d-4436-97fe-86095c69b465 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:48.525936 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b2de148d-a76d-4436-97fe-86095c69b465 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:48.526434 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b2de148d-a76d-4436-97fe-86095c69b465 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:48.527200 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b2de148d-a76d-4436-97fe-86095c69b465 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:48.528200 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b2de148d-a76d-4436-97fe-86095c69b465 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:48.528918 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b2de148d-a76d-4436-97fe-86095c69b465 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:48.546305 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.wsgi [None req-b2de148d-a76d-4436-97fe-86095c69b465 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] HTTP exception thrown: Instance 40fde0c1-f011-4e1b-a4fa-cecb0d44132b could not be found. Aug 24 03:31:48.548064 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-b2de148d-a76d-4436-97fe-86095c69b465 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Request method failure captured: Aug 24 03:31:48.548064 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: request: GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b HTTP/1.1 Aug 24 03:31:48.548064 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept: application/json Aug 24 03:31:48.548064 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept-Encoding: identity Aug 24 03:31:48.548064 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Connection: close Aug 24 03:31:48.548064 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Length: 0 Aug 24 03:31:48.548064 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Type: application/json Aug 24 03:31:48.548064 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Host: 10.222.0.81 Aug 24 03:31:48.548064 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Openstack-System-Scope: None Aug 24 03:31:48.548064 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: User-Agent: python-urllib3/1.26.11 Aug 24 03:31:48.548064 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Auth-Token: gAAAAABjBZuM0b18_jQEb2HurhsFrx9zAhpknBy656gbHBAAbMzXVKdULVQW8twGE9Op-9TtEPh-79YnDHiQPFO9RJc3x_uVzoU9q5eBI8o6gcKo3cK7A6E72_41NS9PgRRFjn4fl5XpzO9-Wja4hbp85-RhyDFMgf9wMn2GH9yYRlKEPJjC6X0 Aug 24 03:31:48.548064 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Id: None Aug 24 03:31:48.548064 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Name: None Aug 24 03:31:48.548064 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Identity-Status: Confirmed Aug 24 03:31:48.548064 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Is-Admin-Project: True Aug 24 03:31:48.548064 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Id: default Aug 24 03:31:48.548064 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Name: Default Aug 24 03:31:48.548064 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Id: f82c6dd205d640a4a78c23050a8f73af Aug 24 03:31:48.548064 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Name: tempest-VolumesActionsTest-917702961 Aug 24 03:31:48.548064 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Role: reader,member Aug 24 03:31:48.548064 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Roles: reader,member Aug 24 03:31:48.549733 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f82c6dd205d640a4a78c23050a8f73af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f82c6dd205d640a4a78c23050a8f73af", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f82c6dd205d640a4a78c23050a8f73af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f82c6dd205d640a4a78c23050a8f73af"}]}] Aug 24 03:31:48.549733 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant: tempest-VolumesActionsTest-917702961 Aug 24 03:31:48.549733 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Id: f82c6dd205d640a4a78c23050a8f73af Aug 24 03:31:48.549733 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Name: tempest-VolumesActionsTest-917702961 Aug 24 03:31:48.549733 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User: tempest-VolumesActionsTest-917702961-project Aug 24 03:31:48.549733 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Id: default Aug 24 03:31:48.549733 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Name: Default Aug 24 03:31:48.549733 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Id: ed0a2e4acb9f4eab98f96e3fa3001099 Aug 24 03:31:48.549733 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Name: tempest-VolumesActionsTest-917702961-project Aug 24 03:31:48.549733 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: method: > Aug 24 03:31:48.549733 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: exception: Instance 40fde0c1-f011-4e1b-a4fa-cecb0d44132b could not be found. Aug 24 03:31:48.549733 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: action_args: {'id': '40fde0c1-f011-4e1b-a4fa-cecb0d44132b'} Aug 24 03:31:48.550581 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:31:48.550581 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:48.550581 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:31:48.550581 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:31:48.550581 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:31:48.550581 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:31:48.550581 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:31:48.550581 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:31:48.550581 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:31:48.550581 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:31:48.550581 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40fde0c1-f011-4e1b-a4fa-cecb0d44132b could not be found. Aug 24 03:31:48.550581 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:31:48.550581 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:48.550581 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:31:48.550581 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:48.550581 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:48.550581 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:48.550581 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:31:48.550581 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:31:48.550581 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:31:48.551815 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:31:48.551815 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:31:48.551815 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:31:48.551815 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:31:48.551815 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:31:48.551815 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:31:48.551815 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:31:48.551815 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40fde0c1-f011-4e1b-a4fa-cecb0d44132b could not be found. Aug 24 03:31:48.551815 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:31:48.551815 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:31:48.551815 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:31:48.551815 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:31:48.551815 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:31:48.551815 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:31:48.551815 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:31:48.551815 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:31:48.551815 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40fde0c1-f011-4e1b-a4fa-cecb0d44132b could not be found. Aug 24 03:31:48.551815 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:31:48.552842 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-b2de148d-a76d-4436-97fe-86095c69b465 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Returning 404 to user: Instance 40fde0c1-f011-4e1b-a4fa-cecb0d44132b could not be found. {{(pid=120709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:31:48.552842 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-b2de148d-a76d-4436-97fe-86095c69b465 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b" status: 404 len: 111 microversion: 2.1 time: 0.036370 Aug 24 03:31:48.552842 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 113/218] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:48 2022] GET /compute/v2.1/servers/40fde0c1-f011-4e1b-a4fa-cecb0d44132b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:31:48.565108 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-9c807305-9a2f-4a83-8637-34009627a529 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:48.565792 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-9c807305-9a2f-4a83-8637-34009627a529 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:48.575736 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9c807305-9a2f-4a83-8637-34009627a529 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:48.576598 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9c807305-9a2f-4a83-8637-34009627a529 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:48.578691 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9c807305-9a2f-4a83-8637-34009627a529 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:48.580208 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9c807305-9a2f-4a83-8637-34009627a529 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:48.581097 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9c807305-9a2f-4a83-8637-34009627a529 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:48.581691 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9c807305-9a2f-4a83-8637-34009627a529 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:48.671573 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-0b3c3d0c-1c6d-4571-8731-8fc75abd4227 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-320559102", "imageRef": "b7a40f0c-20c2-44cd-8b0e-f6e73a007d3e", "flavorRef": "452", "networks": [{"uuid": "d8b14bbe-b5e3-4c85-93fd-466ec3cf3434"}]}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:48.741184 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.network.neutron [None req-0b3c3d0c-1c6d-4571-8731-8fc75abd4227 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] validate_networks() for [('d8b14bbe-b5e3-4c85-93fd-466ec3cf3434', None, None, None, None, None)] {{(pid=120709) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:31:48.742732 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-9c807305-9a2f-4a83-8637-34009627a529 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:48.751806 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-9c807305-9a2f-4a83-8637-34009627a529 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1522 microversion: 2.1 time: 0.191454 Aug 24 03:31:48.752809 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 106/219] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:48 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:48.947092 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-80a56a61-e67f-43c9-98e3-c236995a5d42 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:48.948044 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-80a56a61-e67f-43c9-98e3-c236995a5d42 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:48.957452 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-80a56a61-e67f-43c9-98e3-c236995a5d42 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:48.958412 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-80a56a61-e67f-43c9-98e3-c236995a5d42 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:48.959175 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-80a56a61-e67f-43c9-98e3-c236995a5d42 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:48.960196 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-80a56a61-e67f-43c9-98e3-c236995a5d42 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:48.960844 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-80a56a61-e67f-43c9-98e3-c236995a5d42 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:48.961477 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-80a56a61-e67f-43c9-98e3-c236995a5d42 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:49.252836 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-80a56a61-e67f-43c9-98e3-c236995a5d42 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:49.265940 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-0b3c3d0c-1c6d-4571-8731-8fc75abd4227 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Flavor limits 0:0:0 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:31:49.266426 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-0b3c3d0c-1c6d-4571-8731-8fc75abd4227 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Image limits 0:0:0 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:31:49.267190 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-0b3c3d0c-1c6d-4571-8731-8fc75abd4227 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Flavor pref 0:0:0 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:31:49.268105 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-0b3c3d0c-1c6d-4571-8731-8fc75abd4227 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Image pref 0:0:0 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:31:49.268466 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-0b3c3d0c-1c6d-4571-8731-8fc75abd4227 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:31:49.275861 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-80a56a61-e67f-43c9-98e3-c236995a5d42 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:49.277627 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-80a56a61-e67f-43c9-98e3-c236995a5d42 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:49.278908 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-80a56a61-e67f-43c9-98e3-c236995a5d42 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1405 microversion: 2.20 time: 0.337393 Aug 24 03:31:49.297237 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0b3c3d0c-1c6d-4571-8731-8fc75abd4227 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:49.297237 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0b3c3d0c-1c6d-4571-8731-8fc75abd4227 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:49.297237 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0b3c3d0c-1c6d-4571-8731-8fc75abd4227 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:49.297237 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0b3c3d0c-1c6d-4571-8731-8fc75abd4227 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:49.297783 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0b3c3d0c-1c6d-4571-8731-8fc75abd4227 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:49.297783 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0b3c3d0c-1c6d-4571-8731-8fc75abd4227 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:49.298538 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 107/220] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:48 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1405 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:31:49.317560 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.quota [None req-0b3c3d0c-1c6d-4571-8731-8fc75abd4227 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Getting quotas for project f82c6dd205d640a4a78c23050a8f73af. Resources: {'ram', 'instances', 'cores'} {{(pid=120709) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:31:49.324562 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.quota [None req-0b3c3d0c-1c6d-4571-8731-8fc75abd4227 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Getting quotas for user ed0a2e4acb9f4eab98f96e3fa3001099 and project f82c6dd205d640a4a78c23050a8f73af. Resources: {'ram', 'instances', 'cores'} {{(pid=120709) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:31:49.342224 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-0b3c3d0c-1c6d-4571-8731-8fc75abd4227 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Going to run 1 instances... {{(pid=120709) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:31:49.346244 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-0b3c3d0c-1c6d-4571-8731-8fc75abd4227 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 222caa51-3279-42d1-8493-ecdaaadfd03b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b7a40f0c-20c2-44cd-8b0e-f6e73a007d3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120709) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:31:49.406010 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-0b3c3d0c-1c6d-4571-8731-8fc75abd4227 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.746448 Aug 24 03:31:49.409078 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 114/221] 10.222.0.81 () {60 vars in 1147 bytes} [Wed Aug 24 03:31:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:31:49.422573 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a996e277-516e-41a8-8ff5-7822a057edc5 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:49.423482 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a996e277-516e-41a8-8ff5-7822a057edc5 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 222caa51-3279-42d1-8493-ecdaaadfd03b] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:49.496875 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a996e277-516e-41a8-8ff5-7822a057edc5 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a2e4acb9f4eab98f96e3fa3001099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82c6dd205d640a4a78c23050a8f73af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:49.518347 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a996e277-516e-41a8-8ff5-7822a057edc5 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "GET /compute/v2.1/servers/222caa51-3279-42d1-8493-ecdaaadfd03b" status: 200 len: 1213 microversion: 2.1 time: 0.101507 Aug 24 03:31:49.519609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 108/222] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:49 2022] GET /compute/v2.1/servers/222caa51-3279-42d1-8493-ecdaaadfd03b => generated 1213 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:49.774701 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-afba47ea-3db6-480c-90eb-dd056321d34c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:49.775400 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-afba47ea-3db6-480c-90eb-dd056321d34c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:49.782793 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-afba47ea-3db6-480c-90eb-dd056321d34c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:49.783547 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-afba47ea-3db6-480c-90eb-dd056321d34c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:49.784189 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-afba47ea-3db6-480c-90eb-dd056321d34c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:49.785632 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-afba47ea-3db6-480c-90eb-dd056321d34c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:49.786790 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-afba47ea-3db6-480c-90eb-dd056321d34c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:49.787906 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-afba47ea-3db6-480c-90eb-dd056321d34c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:50.019041 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-afba47ea-3db6-480c-90eb-dd056321d34c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:50.029588 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-afba47ea-3db6-480c-90eb-dd056321d34c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1522 microversion: 2.1 time: 0.258358 Aug 24 03:31:50.031910 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 115/223] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:49 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:50.306816 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c7d24dc3-8f02-48f9-825e-2da5afda29df tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:50.307346 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c7d24dc3-8f02-48f9-825e-2da5afda29df tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:50.313882 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c7d24dc3-8f02-48f9-825e-2da5afda29df tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:50.314577 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c7d24dc3-8f02-48f9-825e-2da5afda29df tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:50.315008 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c7d24dc3-8f02-48f9-825e-2da5afda29df tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:50.315691 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c7d24dc3-8f02-48f9-825e-2da5afda29df tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:50.316140 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c7d24dc3-8f02-48f9-825e-2da5afda29df tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:50.316562 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c7d24dc3-8f02-48f9-825e-2da5afda29df tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:50.466152 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c7d24dc3-8f02-48f9-825e-2da5afda29df tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:50.476697 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c7d24dc3-8f02-48f9-825e-2da5afda29df tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:50.478536 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c7d24dc3-8f02-48f9-825e-2da5afda29df tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:50.479675 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c7d24dc3-8f02-48f9-825e-2da5afda29df tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1405 microversion: 2.20 time: 0.176810 Aug 24 03:31:50.495006 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 109/224] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:50 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:50.542667 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-5c1446c0-a85f-4283-8d48-8736f89353e6 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:50.543359 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-5c1446c0-a85f-4283-8d48-8736f89353e6 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 222caa51-3279-42d1-8493-ecdaaadfd03b] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:50.561807 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-a9098e46-dcba-4d2c-8ab3-3d89fcc67f1e req-bd180d02-d2f5-42b5-82ae-495bec3cc860 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a89effc-2ad4-414e-bca5-d503b48fb040", "name": "network-vif-plugged", "status": "completed", "tag": "57289a66-609a-46ea-b8c8-5258bbaf0864"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:50.562935 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5c1446c0-a85f-4283-8d48-8736f89353e6 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:50.563429 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5c1446c0-a85f-4283-8d48-8736f89353e6 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:50.563864 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5c1446c0-a85f-4283-8d48-8736f89353e6 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:50.564568 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5c1446c0-a85f-4283-8d48-8736f89353e6 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:50.565042 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5c1446c0-a85f-4283-8d48-8736f89353e6 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:50.565464 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5c1446c0-a85f-4283-8d48-8736f89353e6 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:50.573305 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-a9098e46-dcba-4d2c-8ab3-3d89fcc67f1e req-bd180d02-d2f5-42b5-82ae-495bec3cc860 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:50.574093 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-a9098e46-dcba-4d2c-8ab3-3d89fcc67f1e req-bd180d02-d2f5-42b5-82ae-495bec3cc860 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:50.574753 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-a9098e46-dcba-4d2c-8ab3-3d89fcc67f1e req-bd180d02-d2f5-42b5-82ae-495bec3cc860 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:50.589332 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-a9098e46-dcba-4d2c-8ab3-3d89fcc67f1e req-bd180d02-d2f5-42b5-82ae-495bec3cc860 service nova] Creating event network-vif-plugged:57289a66-609a-46ea-b8c8-5258bbaf0864 for instance 4a89effc-2ad4-414e-bca5-d503b48fb040 on hv-cinder-85426 Aug 24 03:31:50.596145 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-a9098e46-dcba-4d2c-8ab3-3d89fcc67f1e req-bd180d02-d2f5-42b5-82ae-495bec3cc860 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038116 Aug 24 03:31:50.597408 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 110/225] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:31:50.695421 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-5c1446c0-a85f-4283-8d48-8736f89353e6 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a2e4acb9f4eab98f96e3fa3001099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82c6dd205d640a4a78c23050a8f73af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:50.705605 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-5c1446c0-a85f-4283-8d48-8736f89353e6 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "GET /compute/v2.1/servers/222caa51-3279-42d1-8493-ecdaaadfd03b" status: 200 len: 1265 microversion: 2.1 time: 0.166999 Aug 24 03:31:50.706459 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 116/226] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:50 2022] GET /compute/v2.1/servers/222caa51-3279-42d1-8493-ecdaaadfd03b => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:51.054668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a9af94f4-9223-40c6-859c-abd41cb45adb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:51.055363 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a9af94f4-9223-40c6-859c-abd41cb45adb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:51.061600 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a9af94f4-9223-40c6-859c-abd41cb45adb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:51.063218 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a9af94f4-9223-40c6-859c-abd41cb45adb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:51.063905 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a9af94f4-9223-40c6-859c-abd41cb45adb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:51.064619 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a9af94f4-9223-40c6-859c-abd41cb45adb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:51.065409 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a9af94f4-9223-40c6-859c-abd41cb45adb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:51.066161 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a9af94f4-9223-40c6-859c-abd41cb45adb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:51.083492 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:51.295782 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a9af94f4-9223-40c6-859c-abd41cb45adb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:51.309400 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a9af94f4-9223-40c6-859c-abd41cb45adb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1522 microversion: 2.1 time: 0.257943 Aug 24 03:31:51.310956 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 111/227] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:51 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:51.502766 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-ae910078-d470-4f2f-86fe-4b927aadb949 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:51.508685 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-ae910078-d470-4f2f-86fe-4b927aadb949 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:51.517389 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ae910078-d470-4f2f-86fe-4b927aadb949 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:51.518199 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ae910078-d470-4f2f-86fe-4b927aadb949 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:51.518881 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ae910078-d470-4f2f-86fe-4b927aadb949 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:51.519748 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ae910078-d470-4f2f-86fe-4b927aadb949 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:51.520348 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ae910078-d470-4f2f-86fe-4b927aadb949 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:51.520992 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ae910078-d470-4f2f-86fe-4b927aadb949 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:51.731388 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c0f14a6f-7d18-407c-a943-7100ec7a1dbe tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:51.732149 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c0f14a6f-7d18-407c-a943-7100ec7a1dbe tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 222caa51-3279-42d1-8493-ecdaaadfd03b] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:51.741604 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c0f14a6f-7d18-407c-a943-7100ec7a1dbe tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:51.742511 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c0f14a6f-7d18-407c-a943-7100ec7a1dbe tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:51.743016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c0f14a6f-7d18-407c-a943-7100ec7a1dbe tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:51.743811 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c0f14a6f-7d18-407c-a943-7100ec7a1dbe tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:51.744337 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c0f14a6f-7d18-407c-a943-7100ec7a1dbe tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:51.744860 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c0f14a6f-7d18-407c-a943-7100ec7a1dbe tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:52.073247 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-ae910078-d470-4f2f-86fe-4b927aadb949 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:52.082765 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-ae910078-d470-4f2f-86fe-4b927aadb949 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:52.084288 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-ae910078-d470-4f2f-86fe-4b927aadb949 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:52.085436 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-ae910078-d470-4f2f-86fe-4b927aadb949 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1405 microversion: 2.20 time: 0.586677 Aug 24 03:31:52.086159 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 117/228] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:51 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1405 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:52.095828 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c0f14a6f-7d18-407c-a943-7100ec7a1dbe tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a2e4acb9f4eab98f96e3fa3001099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82c6dd205d640a4a78c23050a8f73af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:52.102939 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c0f14a6f-7d18-407c-a943-7100ec7a1dbe tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "GET /compute/v2.1/servers/222caa51-3279-42d1-8493-ecdaaadfd03b" status: 200 len: 1313 microversion: 2.1 time: 0.375393 Aug 24 03:31:52.103747 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 112/229] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:51 2022] GET /compute/v2.1/servers/222caa51-3279-42d1-8493-ecdaaadfd03b => generated 1313 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:31:52.336984 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-1fdf845f-016b-40ed-877e-99ae2fcde1ca tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:52.338003 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-1fdf845f-016b-40ed-877e-99ae2fcde1ca tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:52.357572 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1fdf845f-016b-40ed-877e-99ae2fcde1ca tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:52.358157 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1fdf845f-016b-40ed-877e-99ae2fcde1ca tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:52.358662 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1fdf845f-016b-40ed-877e-99ae2fcde1ca tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:52.360095 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1fdf845f-016b-40ed-877e-99ae2fcde1ca tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:52.360716 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1fdf845f-016b-40ed-877e-99ae2fcde1ca tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:52.361254 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1fdf845f-016b-40ed-877e-99ae2fcde1ca tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:52.607630 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-1fdf845f-016b-40ed-877e-99ae2fcde1ca tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:52.615875 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-1fdf845f-016b-40ed-877e-99ae2fcde1ca tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1522 microversion: 2.1 time: 0.289350 Aug 24 03:31:52.616447 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 118/230] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:52 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:52.787023 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-aee0e0e4-215b-4e93-91db-9fc59ecfd7f7 req-2fb6dff5-188f-4497-980b-08acd1616964 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "222caa51-3279-42d1-8493-ecdaaadfd03b", "tag": "e2ba287f-9853-42e5-92fb-e01bc233abde"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:52.797072 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-aee0e0e4-215b-4e93-91db-9fc59ecfd7f7 req-2fb6dff5-188f-4497-980b-08acd1616964 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:52.797550 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-aee0e0e4-215b-4e93-91db-9fc59ecfd7f7 req-2fb6dff5-188f-4497-980b-08acd1616964 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:52.797979 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-aee0e0e4-215b-4e93-91db-9fc59ecfd7f7 req-2fb6dff5-188f-4497-980b-08acd1616964 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:52.957996 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-aee0e0e4-215b-4e93-91db-9fc59ecfd7f7 req-2fb6dff5-188f-4497-980b-08acd1616964 service nova] Creating event network-changed:e2ba287f-9853-42e5-92fb-e01bc233abde for instance 222caa51-3279-42d1-8493-ecdaaadfd03b on hv-cinder-85426 Aug 24 03:31:52.965603 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-aee0e0e4-215b-4e93-91db-9fc59ecfd7f7 req-2fb6dff5-188f-4497-980b-08acd1616964 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182102 Aug 24 03:31:52.966223 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 113/231] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:53.110904 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-4b5a3510-62f6-4a07-a138-dab2d76554c2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:53.111585 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-4b5a3510-62f6-4a07-a138-dab2d76554c2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:53.117627 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4b5a3510-62f6-4a07-a138-dab2d76554c2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:53.118112 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4b5a3510-62f6-4a07-a138-dab2d76554c2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:53.118718 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4b5a3510-62f6-4a07-a138-dab2d76554c2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:53.119503 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4b5a3510-62f6-4a07-a138-dab2d76554c2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:53.119962 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4b5a3510-62f6-4a07-a138-dab2d76554c2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:53.120386 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4b5a3510-62f6-4a07-a138-dab2d76554c2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:53.130220 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d3f66a20-7041-446f-a3d0-6d207062682d tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:53.131372 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d3f66a20-7041-446f-a3d0-6d207062682d tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 222caa51-3279-42d1-8493-ecdaaadfd03b] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:53.138356 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d3f66a20-7041-446f-a3d0-6d207062682d tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:53.139088 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d3f66a20-7041-446f-a3d0-6d207062682d tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:53.139702 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d3f66a20-7041-446f-a3d0-6d207062682d tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:53.140538 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d3f66a20-7041-446f-a3d0-6d207062682d tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:53.141847 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d3f66a20-7041-446f-a3d0-6d207062682d tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:53.142466 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d3f66a20-7041-446f-a3d0-6d207062682d tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:53.430288 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-4b5a3510-62f6-4a07-a138-dab2d76554c2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:53.439483 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-4b5a3510-62f6-4a07-a138-dab2d76554c2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:53.441396 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-4b5a3510-62f6-4a07-a138-dab2d76554c2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:53.442603 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-4b5a3510-62f6-4a07-a138-dab2d76554c2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1597 microversion: 2.20 time: 0.336380 Aug 24 03:31:53.443160 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 119/232] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:31:53 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1597 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:31:53.467214 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-9610a1c7-9a90-41a5-979b-f69b36fce768 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:53.468015 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-9610a1c7-9a90-41a5-979b-f69b36fce768 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:53.474310 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9610a1c7-9a90-41a5-979b-f69b36fce768 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:53.474791 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9610a1c7-9a90-41a5-979b-f69b36fce768 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:53.475376 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9610a1c7-9a90-41a5-979b-f69b36fce768 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:53.476216 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9610a1c7-9a90-41a5-979b-f69b36fce768 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:53.476383 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d3f66a20-7041-446f-a3d0-6d207062682d tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a2e4acb9f4eab98f96e3fa3001099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82c6dd205d640a4a78c23050a8f73af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:53.476911 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9610a1c7-9a90-41a5-979b-f69b36fce768 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:53.477333 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9610a1c7-9a90-41a5-979b-f69b36fce768 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:53.489293 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d3f66a20-7041-446f-a3d0-6d207062682d tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "GET /compute/v2.1/servers/222caa51-3279-42d1-8493-ecdaaadfd03b" status: 200 len: 1313 microversion: 2.1 time: 0.367067 Aug 24 03:31:53.490696 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 114/233] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:53 2022] GET /compute/v2.1/servers/222caa51-3279-42d1-8493-ecdaaadfd03b => generated 1313 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:53.584320 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-9610a1c7-9a90-41a5-979b-f69b36fce768 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.121498 Aug 24 03:31:53.585073 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 120/234] 10.222.0.81 () {60 vars in 1316 bytes} [Wed Aug 24 03:31:53 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040/os-interface => generated 284 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:31:53.640747 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2902b570-a848-4f2e-a2cf-3a2451581b71 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:53.642151 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2902b570-a848-4f2e-a2cf-3a2451581b71 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:53.648487 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2902b570-a848-4f2e-a2cf-3a2451581b71 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:53.649012 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2902b570-a848-4f2e-a2cf-3a2451581b71 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:53.649504 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2902b570-a848-4f2e-a2cf-3a2451581b71 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:53.650233 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2902b570-a848-4f2e-a2cf-3a2451581b71 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:53.650687 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2902b570-a848-4f2e-a2cf-3a2451581b71 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:53.651137 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2902b570-a848-4f2e-a2cf-3a2451581b71 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:53.809065 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2902b570-a848-4f2e-a2cf-3a2451581b71 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:53.817986 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2902b570-a848-4f2e-a2cf-3a2451581b71 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1522 microversion: 2.1 time: 0.182970 Aug 24 03:31:53.818550 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 115/235] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:53 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:54.513007 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-4e4545a8-aec6-4f15-8c63-4eb5a323c90c tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:54.513525 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-4e4545a8-aec6-4f15-8c63-4eb5a323c90c tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 222caa51-3279-42d1-8493-ecdaaadfd03b] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:54.520713 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4e4545a8-aec6-4f15-8c63-4eb5a323c90c tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:54.521221 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4e4545a8-aec6-4f15-8c63-4eb5a323c90c tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:54.521654 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4e4545a8-aec6-4f15-8c63-4eb5a323c90c tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:54.522525 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4e4545a8-aec6-4f15-8c63-4eb5a323c90c tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:54.522978 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4e4545a8-aec6-4f15-8c63-4eb5a323c90c tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:54.523399 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4e4545a8-aec6-4f15-8c63-4eb5a323c90c tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:54.671145 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-4e4545a8-aec6-4f15-8c63-4eb5a323c90c tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a2e4acb9f4eab98f96e3fa3001099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82c6dd205d640a4a78c23050a8f73af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:54.679256 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-4e4545a8-aec6-4f15-8c63-4eb5a323c90c tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "GET /compute/v2.1/servers/222caa51-3279-42d1-8493-ecdaaadfd03b" status: 200 len: 1313 microversion: 2.1 time: 0.170220 Aug 24 03:31:54.679839 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 121/236] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:54 2022] GET /compute/v2.1/servers/222caa51-3279-42d1-8493-ecdaaadfd03b => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:54.842217 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-db607def-e2f6-4a1d-ac4e-3a0d56a4d398 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:54.843436 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-db607def-e2f6-4a1d-ac4e-3a0d56a4d398 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:54.852704 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-db607def-e2f6-4a1d-ac4e-3a0d56a4d398 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:54.853290 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-db607def-e2f6-4a1d-ac4e-3a0d56a4d398 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:54.853883 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-db607def-e2f6-4a1d-ac4e-3a0d56a4d398 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:54.854600 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-db607def-e2f6-4a1d-ac4e-3a0d56a4d398 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:54.855062 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-db607def-e2f6-4a1d-ac4e-3a0d56a4d398 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:54.856200 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-db607def-e2f6-4a1d-ac4e-3a0d56a4d398 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:54.927718 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-05e0e267-6f22-4033-8d24-439a9b57c7d0 req-870721fa-6e65-418a-9d71-424e816360ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a89effc-2ad4-414e-bca5-d503b48fb040", "tag": "57289a66-609a-46ea-b8c8-5258bbaf0864"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:54.938748 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-05e0e267-6f22-4033-8d24-439a9b57c7d0 req-870721fa-6e65-418a-9d71-424e816360ee service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:54.939570 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-05e0e267-6f22-4033-8d24-439a9b57c7d0 req-870721fa-6e65-418a-9d71-424e816360ee service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:54.941263 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-05e0e267-6f22-4033-8d24-439a9b57c7d0 req-870721fa-6e65-418a-9d71-424e816360ee service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:54.966075 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-05e0e267-6f22-4033-8d24-439a9b57c7d0 req-870721fa-6e65-418a-9d71-424e816360ee service nova] Creating event network-changed:57289a66-609a-46ea-b8c8-5258bbaf0864 for instance 4a89effc-2ad4-414e-bca5-d503b48fb040 on hv-cinder-85426 Aug 24 03:31:54.972757 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-05e0e267-6f22-4033-8d24-439a9b57c7d0 req-870721fa-6e65-418a-9d71-424e816360ee service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049873 Aug 24 03:31:54.973973 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 122/237] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:31:55.112561 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-db607def-e2f6-4a1d-ac4e-3a0d56a4d398 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:55.127663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-db607def-e2f6-4a1d-ac4e-3a0d56a4d398 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1522 microversion: 2.1 time: 0.289189 Aug 24 03:31:55.129024 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 116/238] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:54 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:55.615958 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-c2e49be2-9c34-4c2f-b5f6-0d955969011d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:55.617644 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-c2e49be2-9c34-4c2f-b5f6-0d955969011d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:55.624697 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c2e49be2-9c34-4c2f-b5f6-0d955969011d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:55.626186 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c2e49be2-9c34-4c2f-b5f6-0d955969011d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:55.627929 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c2e49be2-9c34-4c2f-b5f6-0d955969011d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:55.628727 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c2e49be2-9c34-4c2f-b5f6-0d955969011d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:55.629363 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c2e49be2-9c34-4c2f-b5f6-0d955969011d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:55.629921 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c2e49be2-9c34-4c2f-b5f6-0d955969011d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:55.656214 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-c2e49be2-9c34-4c2f-b5f6-0d955969011d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8/ips" status: 200 len: 147 microversion: 2.1 time: 0.044369 Aug 24 03:31:55.657790 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 123/239] 10.222.0.81 () {58 vars in 1248 bytes} [Wed Aug 24 03:31:55 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8/ips => generated 147 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:55.700415 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a85b199c-6ff7-4e97-a5b3-3c605939989c tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:55.701045 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a85b199c-6ff7-4e97-a5b3-3c605939989c tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 222caa51-3279-42d1-8493-ecdaaadfd03b] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:55.707441 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a85b199c-6ff7-4e97-a5b3-3c605939989c tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:55.707920 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a85b199c-6ff7-4e97-a5b3-3c605939989c tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:55.708354 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a85b199c-6ff7-4e97-a5b3-3c605939989c tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:55.709064 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a85b199c-6ff7-4e97-a5b3-3c605939989c tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:55.709513 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a85b199c-6ff7-4e97-a5b3-3c605939989c tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:55.709929 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a85b199c-6ff7-4e97-a5b3-3c605939989c tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:55.863983 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a85b199c-6ff7-4e97-a5b3-3c605939989c tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a2e4acb9f4eab98f96e3fa3001099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82c6dd205d640a4a78c23050a8f73af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:55.872037 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a85b199c-6ff7-4e97-a5b3-3c605939989c tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "GET /compute/v2.1/servers/222caa51-3279-42d1-8493-ecdaaadfd03b" status: 200 len: 1313 microversion: 2.1 time: 0.175405 Aug 24 03:31:55.872598 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 117/240] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:55 2022] GET /compute/v2.1/servers/222caa51-3279-42d1-8493-ecdaaadfd03b => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:56.150928 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-25218a45-7db0-43d8-81f5-b5c0e9568b40 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:56.151457 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-25218a45-7db0-43d8-81f5-b5c0e9568b40 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:56.158499 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-25218a45-7db0-43d8-81f5-b5c0e9568b40 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:56.159070 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-25218a45-7db0-43d8-81f5-b5c0e9568b40 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:56.159542 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-25218a45-7db0-43d8-81f5-b5c0e9568b40 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:56.160255 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-25218a45-7db0-43d8-81f5-b5c0e9568b40 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:56.160742 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-25218a45-7db0-43d8-81f5-b5c0e9568b40 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:56.161278 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-25218a45-7db0-43d8-81f5-b5c0e9568b40 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:56.315351 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-25218a45-7db0-43d8-81f5-b5c0e9568b40 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:56.323635 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-25218a45-7db0-43d8-81f5-b5c0e9568b40 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1522 microversion: 2.1 time: 0.176649 Aug 24 03:31:56.324204 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 124/241] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:56 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:56.893832 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ccf64283-26ff-4507-8d9c-c3f972b75dc1 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:56.894444 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ccf64283-26ff-4507-8d9c-c3f972b75dc1 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 222caa51-3279-42d1-8493-ecdaaadfd03b] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:56.900952 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ccf64283-26ff-4507-8d9c-c3f972b75dc1 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:56.901433 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ccf64283-26ff-4507-8d9c-c3f972b75dc1 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:56.901863 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ccf64283-26ff-4507-8d9c-c3f972b75dc1 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:56.902566 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ccf64283-26ff-4507-8d9c-c3f972b75dc1 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:56.903017 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ccf64283-26ff-4507-8d9c-c3f972b75dc1 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:56.903437 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ccf64283-26ff-4507-8d9c-c3f972b75dc1 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:57.043575 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ccf64283-26ff-4507-8d9c-c3f972b75dc1 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a2e4acb9f4eab98f96e3fa3001099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82c6dd205d640a4a78c23050a8f73af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:57.053577 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ccf64283-26ff-4507-8d9c-c3f972b75dc1 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "GET /compute/v2.1/servers/222caa51-3279-42d1-8493-ecdaaadfd03b" status: 200 len: 1313 microversion: 2.1 time: 0.163785 Aug 24 03:31:57.054164 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 118/242] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:56 2022] GET /compute/v2.1/servers/222caa51-3279-42d1-8493-ecdaaadfd03b => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:57.346066 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-e19cc978-fda8-4d7c-8d20-2463da993104 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:57.346686 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-e19cc978-fda8-4d7c-8d20-2463da993104 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:57.352616 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e19cc978-fda8-4d7c-8d20-2463da993104 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:57.353136 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e19cc978-fda8-4d7c-8d20-2463da993104 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:57.353575 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e19cc978-fda8-4d7c-8d20-2463da993104 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:57.354260 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e19cc978-fda8-4d7c-8d20-2463da993104 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:57.354716 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e19cc978-fda8-4d7c-8d20-2463da993104 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:57.355142 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e19cc978-fda8-4d7c-8d20-2463da993104 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:57.492214 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-e19cc978-fda8-4d7c-8d20-2463da993104 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:57.499873 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-e19cc978-fda8-4d7c-8d20-2463da993104 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1522 microversion: 2.1 time: 0.158332 Aug 24 03:31:57.500436 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 125/243] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:57 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:58.075533 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4297344b-6943-43da-bb85-af1be7333973 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:58.076141 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-4297344b-6943-43da-bb85-af1be7333973 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 222caa51-3279-42d1-8493-ecdaaadfd03b] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:58.084473 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4297344b-6943-43da-bb85-af1be7333973 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:58.085278 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4297344b-6943-43da-bb85-af1be7333973 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:58.085821 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4297344b-6943-43da-bb85-af1be7333973 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:58.086692 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4297344b-6943-43da-bb85-af1be7333973 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:58.087187 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4297344b-6943-43da-bb85-af1be7333973 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:58.087621 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4297344b-6943-43da-bb85-af1be7333973 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:58.227161 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4297344b-6943-43da-bb85-af1be7333973 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a2e4acb9f4eab98f96e3fa3001099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82c6dd205d640a4a78c23050a8f73af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:58.234969 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4297344b-6943-43da-bb85-af1be7333973 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "GET /compute/v2.1/servers/222caa51-3279-42d1-8493-ecdaaadfd03b" status: 200 len: 1313 microversion: 2.1 time: 0.163277 Aug 24 03:31:58.236167 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 119/244] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:58 2022] GET /compute/v2.1/servers/222caa51-3279-42d1-8493-ecdaaadfd03b => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:58.522094 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-9405ea75-1943-4d52-a2b7-a048e6244064 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:58.522837 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-9405ea75-1943-4d52-a2b7-a048e6244064 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:58.529022 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9405ea75-1943-4d52-a2b7-a048e6244064 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:58.529552 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9405ea75-1943-4d52-a2b7-a048e6244064 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:58.530123 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9405ea75-1943-4d52-a2b7-a048e6244064 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:58.531285 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9405ea75-1943-4d52-a2b7-a048e6244064 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:58.532428 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9405ea75-1943-4d52-a2b7-a048e6244064 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:58.532885 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9405ea75-1943-4d52-a2b7-a048e6244064 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:58.550679 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-62749a90-bd87-4eeb-a97d-94e5b7cfdd4f req-2e87db0a-f83a-46b4-8c18-ab1ecd863e66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "222caa51-3279-42d1-8493-ecdaaadfd03b", "name": "network-vif-plugged", "status": "completed", "tag": "e2ba287f-9853-42e5-92fb-e01bc233abde"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:58.568744 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-62749a90-bd87-4eeb-a97d-94e5b7cfdd4f req-2e87db0a-f83a-46b4-8c18-ab1ecd863e66 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:58.569602 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-62749a90-bd87-4eeb-a97d-94e5b7cfdd4f req-2e87db0a-f83a-46b4-8c18-ab1ecd863e66 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:58.570224 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-62749a90-bd87-4eeb-a97d-94e5b7cfdd4f req-2e87db0a-f83a-46b4-8c18-ab1ecd863e66 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:58.583177 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-62749a90-bd87-4eeb-a97d-94e5b7cfdd4f req-2e87db0a-f83a-46b4-8c18-ab1ecd863e66 service nova] Creating event network-vif-plugged:e2ba287f-9853-42e5-92fb-e01bc233abde for instance 222caa51-3279-42d1-8493-ecdaaadfd03b on hv-cinder-85426 Aug 24 03:31:58.589508 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-62749a90-bd87-4eeb-a97d-94e5b7cfdd4f req-2e87db0a-f83a-46b4-8c18-ab1ecd863e66 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047065 Aug 24 03:31:58.590486 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 120/245] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:31:58.735036 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-9405ea75-1943-4d52-a2b7-a048e6244064 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:58.752705 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-9405ea75-1943-4d52-a2b7-a048e6244064 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1522 microversion: 2.1 time: 0.234497 Aug 24 03:31:58.761464 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 126/246] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:58 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:59.257151 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c8b3b440-6d26-4fd6-b47a-0c8509b561f0 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:59.257775 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c8b3b440-6d26-4fd6-b47a-0c8509b561f0 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 222caa51-3279-42d1-8493-ecdaaadfd03b] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:59.263892 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c8b3b440-6d26-4fd6-b47a-0c8509b561f0 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:59.264369 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c8b3b440-6d26-4fd6-b47a-0c8509b561f0 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:59.264814 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c8b3b440-6d26-4fd6-b47a-0c8509b561f0 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:59.265495 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c8b3b440-6d26-4fd6-b47a-0c8509b561f0 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:59.265938 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c8b3b440-6d26-4fd6-b47a-0c8509b561f0 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:59.266861 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c8b3b440-6d26-4fd6-b47a-0c8509b561f0 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:59.402065 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c8b3b440-6d26-4fd6-b47a-0c8509b561f0 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a2e4acb9f4eab98f96e3fa3001099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82c6dd205d640a4a78c23050a8f73af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:59.410865 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c8b3b440-6d26-4fd6-b47a-0c8509b561f0 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "GET /compute/v2.1/servers/222caa51-3279-42d1-8493-ecdaaadfd03b" status: 200 len: 1313 microversion: 2.1 time: 0.158817 Aug 24 03:31:59.411519 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 121/247] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:59 2022] GET /compute/v2.1/servers/222caa51-3279-42d1-8493-ecdaaadfd03b => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:31:59.774357 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-b5e40723-9ad8-4aa5-a884-b1af8893f671 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:59.775070 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-b5e40723-9ad8-4aa5-a884-b1af8893f671 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:59.781593 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell0:SELECT=2 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:59.783245 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell0:SELECT=6 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:59.785132 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b5e40723-9ad8-4aa5-a884-b1af8893f671 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:59.785629 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b5e40723-9ad8-4aa5-a884-b1af8893f671 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:59.786063 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b5e40723-9ad8-4aa5-a884-b1af8893f671 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:59.786774 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b5e40723-9ad8-4aa5-a884-b1af8893f671 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:59.787223 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b5e40723-9ad8-4aa5-a884-b1af8893f671 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:59.787646 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b5e40723-9ad8-4aa5-a884-b1af8893f671 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:59.848691 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2862c1b8-13a2-4a76-ab79-3ba91a5788f9 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f3f6a73-11ac-4d0b-9ab8-1257e821fa11"}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:59.851263 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2862c1b8-13a2-4a76-ab79-3ba91a5788f9 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:59.853329 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=2 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:59.868740 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2862c1b8-13a2-4a76-ab79-3ba91a5788f9 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:59.869298 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2862c1b8-13a2-4a76-ab79-3ba91a5788f9 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:59.869742 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2862c1b8-13a2-4a76-ab79-3ba91a5788f9 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:59.870472 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2862c1b8-13a2-4a76-ab79-3ba91a5788f9 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:59.870901 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2862c1b8-13a2-4a76-ab79-3ba91a5788f9 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:59.871354 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2862c1b8-13a2-4a76-ab79-3ba91a5788f9 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:59.934983 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-b5e40723-9ad8-4aa5-a884-b1af8893f671 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:59.945104 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-b5e40723-9ad8-4aa5-a884-b1af8893f671 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1522 microversion: 2.1 time: 0.174478 Aug 24 03:31:59.945594 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 127/248] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:59 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:00.205878 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2862c1b8-13a2-4a76-ab79-3ba91a5788f9 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "POST /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.361275 Aug 24 03:32:00.206474 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 122/249] 10.222.0.81 () {60 vars in 1323 bytes} [Wed Aug 24 03:31:59 2022] POST /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8/os-volume_attachments => generated 194 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:32:00.431428 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-76c9a55e-86f3-4f0c-bebd-c5eb48049927 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:00.432166 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-76c9a55e-86f3-4f0c-bebd-c5eb48049927 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 222caa51-3279-42d1-8493-ecdaaadfd03b] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:00.438146 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-76c9a55e-86f3-4f0c-bebd-c5eb48049927 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:00.439139 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-76c9a55e-86f3-4f0c-bebd-c5eb48049927 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:00.439574 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-76c9a55e-86f3-4f0c-bebd-c5eb48049927 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:00.440259 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-76c9a55e-86f3-4f0c-bebd-c5eb48049927 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:00.440713 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-76c9a55e-86f3-4f0c-bebd-c5eb48049927 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:00.441158 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-76c9a55e-86f3-4f0c-bebd-c5eb48049927 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:00.574427 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-76c9a55e-86f3-4f0c-bebd-c5eb48049927 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a2e4acb9f4eab98f96e3fa3001099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82c6dd205d640a4a78c23050a8f73af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:00.582574 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-76c9a55e-86f3-4f0c-bebd-c5eb48049927 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "GET /compute/v2.1/servers/222caa51-3279-42d1-8493-ecdaaadfd03b" status: 200 len: 1313 microversion: 2.1 time: 0.155100 Aug 24 03:32:00.583135 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 128/250] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:00 2022] GET /compute/v2.1/servers/222caa51-3279-42d1-8493-ecdaaadfd03b => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:00.968871 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b8388645-86d9-47e6-b76a-b9f950050ca4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:00.971014 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-b8388645-86d9-47e6-b76a-b9f950050ca4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:00.979742 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b8388645-86d9-47e6-b76a-b9f950050ca4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:00.980234 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b8388645-86d9-47e6-b76a-b9f950050ca4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:00.980669 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b8388645-86d9-47e6-b76a-b9f950050ca4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:00.981439 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b8388645-86d9-47e6-b76a-b9f950050ca4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:00.981895 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b8388645-86d9-47e6-b76a-b9f950050ca4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:00.982320 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b8388645-86d9-47e6-b76a-b9f950050ca4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:01.120013 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-b8388645-86d9-47e6-b76a-b9f950050ca4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:01.128602 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-b8388645-86d9-47e6-b76a-b9f950050ca4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1522 microversion: 2.1 time: 0.166425 Aug 24 03:32:01.129208 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 123/251] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:00 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:01.604556 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-e940a5cc-3a30-489e-bb89-2b1270f53525 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:01.605198 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-e940a5cc-3a30-489e-bb89-2b1270f53525 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 222caa51-3279-42d1-8493-ecdaaadfd03b] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:01.611388 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e940a5cc-3a30-489e-bb89-2b1270f53525 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:01.611869 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e940a5cc-3a30-489e-bb89-2b1270f53525 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:01.612309 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e940a5cc-3a30-489e-bb89-2b1270f53525 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:01.613037 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e940a5cc-3a30-489e-bb89-2b1270f53525 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:01.613744 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e940a5cc-3a30-489e-bb89-2b1270f53525 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:01.614177 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e940a5cc-3a30-489e-bb89-2b1270f53525 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:01.757339 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-e940a5cc-3a30-489e-bb89-2b1270f53525 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a2e4acb9f4eab98f96e3fa3001099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82c6dd205d640a4a78c23050a8f73af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:01.764874 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-e940a5cc-3a30-489e-bb89-2b1270f53525 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "GET /compute/v2.1/servers/222caa51-3279-42d1-8493-ecdaaadfd03b" status: 200 len: 1497 microversion: 2.1 time: 0.164422 Aug 24 03:32:01.765429 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 129/252] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:01 2022] GET /compute/v2.1/servers/222caa51-3279-42d1-8493-ecdaaadfd03b => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:02.151242 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-5f633100-2c3d-4377-9d3f-0e59f544203d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:02.152391 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-5f633100-2c3d-4377-9d3f-0e59f544203d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:02.159195 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5f633100-2c3d-4377-9d3f-0e59f544203d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:02.159878 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5f633100-2c3d-4377-9d3f-0e59f544203d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:02.160494 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5f633100-2c3d-4377-9d3f-0e59f544203d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:02.161405 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5f633100-2c3d-4377-9d3f-0e59f544203d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:02.161870 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5f633100-2c3d-4377-9d3f-0e59f544203d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:02.162300 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5f633100-2c3d-4377-9d3f-0e59f544203d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:02.306814 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-5f633100-2c3d-4377-9d3f-0e59f544203d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:02.316828 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-5f633100-2c3d-4377-9d3f-0e59f544203d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1522 microversion: 2.1 time: 0.169793 Aug 24 03:32:02.317400 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 124/253] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:02 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:02.581389 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-4938149b-10e6-4cf6-840b-f9ab0a31723f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:02.581894 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-4938149b-10e6-4cf6-840b-f9ab0a31723f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 222caa51-3279-42d1-8493-ecdaaadfd03b] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:02.587828 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4938149b-10e6-4cf6-840b-f9ab0a31723f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:02.588305 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4938149b-10e6-4cf6-840b-f9ab0a31723f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:02.588738 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4938149b-10e6-4cf6-840b-f9ab0a31723f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:02.589442 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4938149b-10e6-4cf6-840b-f9ab0a31723f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:02.589888 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4938149b-10e6-4cf6-840b-f9ab0a31723f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:02.590329 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4938149b-10e6-4cf6-840b-f9ab0a31723f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:02.616164 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-4938149b-10e6-4cf6-840b-f9ab0a31723f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 222caa51-3279-42d1-8493-ecdaaadfd03b] Going to try to terminate instance {{(pid=120709) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:32:02.618840 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell1:SELECT=100 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:02.694698 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-4938149b-10e6-4cf6-840b-f9ab0a31723f tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "DELETE /compute/v2.1/servers/222caa51-3279-42d1-8493-ecdaaadfd03b" status: 204 len: 0 microversion: 2.1 time: 0.116452 Aug 24 03:32:02.695295 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 130/254] 10.222.0.81 () {58 vars in 1239 bytes} [Wed Aug 24 03:32:02 2022] DELETE /compute/v2.1/servers/222caa51-3279-42d1-8493-ecdaaadfd03b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:32:02.707282 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-094cb21c-5714-4e57-874b-d5d5f975c33c tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:02.709347 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-094cb21c-5714-4e57-874b-d5d5f975c33c tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 222caa51-3279-42d1-8493-ecdaaadfd03b] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:02.726476 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-094cb21c-5714-4e57-874b-d5d5f975c33c tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:02.726961 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-094cb21c-5714-4e57-874b-d5d5f975c33c tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:02.727397 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-094cb21c-5714-4e57-874b-d5d5f975c33c tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:02.728096 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-094cb21c-5714-4e57-874b-d5d5f975c33c tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:02.728545 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-094cb21c-5714-4e57-874b-d5d5f975c33c tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:02.729005 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-094cb21c-5714-4e57-874b-d5d5f975c33c tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:02.857706 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-094cb21c-5714-4e57-874b-d5d5f975c33c tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a2e4acb9f4eab98f96e3fa3001099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82c6dd205d640a4a78c23050a8f73af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:02.865884 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-094cb21c-5714-4e57-874b-d5d5f975c33c tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "GET /compute/v2.1/servers/222caa51-3279-42d1-8493-ecdaaadfd03b" status: 200 len: 1503 microversion: 2.1 time: 0.166069 Aug 24 03:32:02.866445 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 125/255] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:02 2022] GET /compute/v2.1/servers/222caa51-3279-42d1-8493-ecdaaadfd03b => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:03.340332 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-c83def15-e2de-48e6-9d3b-91a78b2cbb6d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:03.341271 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-c83def15-e2de-48e6-9d3b-91a78b2cbb6d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:03.348502 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c83def15-e2de-48e6-9d3b-91a78b2cbb6d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:03.349120 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c83def15-e2de-48e6-9d3b-91a78b2cbb6d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:03.349579 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c83def15-e2de-48e6-9d3b-91a78b2cbb6d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:03.350412 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c83def15-e2de-48e6-9d3b-91a78b2cbb6d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:03.350946 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c83def15-e2de-48e6-9d3b-91a78b2cbb6d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:03.351454 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c83def15-e2de-48e6-9d3b-91a78b2cbb6d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:03.490358 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-c83def15-e2de-48e6-9d3b-91a78b2cbb6d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:03.498206 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-c83def15-e2de-48e6-9d3b-91a78b2cbb6d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1522 microversion: 2.1 time: 0.162825 Aug 24 03:32:03.498769 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 131/256] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:03 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:03.889682 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-30a8adff-f4d1-4baa-b4ba-be5a52edfad8 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:03.890552 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-30a8adff-f4d1-4baa-b4ba-be5a52edfad8 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 222caa51-3279-42d1-8493-ecdaaadfd03b] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:03.897512 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-30a8adff-f4d1-4baa-b4ba-be5a52edfad8 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:03.897998 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-30a8adff-f4d1-4baa-b4ba-be5a52edfad8 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:03.898431 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-30a8adff-f4d1-4baa-b4ba-be5a52edfad8 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:03.899133 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-30a8adff-f4d1-4baa-b4ba-be5a52edfad8 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:03.899583 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-30a8adff-f4d1-4baa-b4ba-be5a52edfad8 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:03.900005 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-30a8adff-f4d1-4baa-b4ba-be5a52edfad8 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:04.034343 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-30a8adff-f4d1-4baa-b4ba-be5a52edfad8 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a2e4acb9f4eab98f96e3fa3001099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82c6dd205d640a4a78c23050a8f73af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:04.042056 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-30a8adff-f4d1-4baa-b4ba-be5a52edfad8 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "GET /compute/v2.1/servers/222caa51-3279-42d1-8493-ecdaaadfd03b" status: 200 len: 1503 microversion: 2.1 time: 0.157107 Aug 24 03:32:04.042619 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 126/257] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:03 2022] GET /compute/v2.1/servers/222caa51-3279-42d1-8493-ecdaaadfd03b => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:04.523143 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-a212868e-2420-481d-8bbb-1bc02d2c40bd tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:04.523769 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-a212868e-2420-481d-8bbb-1bc02d2c40bd tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:04.529616 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a212868e-2420-481d-8bbb-1bc02d2c40bd tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:04.530796 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a212868e-2420-481d-8bbb-1bc02d2c40bd tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:04.531254 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a212868e-2420-481d-8bbb-1bc02d2c40bd tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:04.532253 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a212868e-2420-481d-8bbb-1bc02d2c40bd tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:04.532708 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a212868e-2420-481d-8bbb-1bc02d2c40bd tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:04.533311 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a212868e-2420-481d-8bbb-1bc02d2c40bd tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:04.668612 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-a212868e-2420-481d-8bbb-1bc02d2c40bd tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:04.678210 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-a212868e-2420-481d-8bbb-1bc02d2c40bd tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1522 microversion: 2.1 time: 0.158653 Aug 24 03:32:04.679057 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 132/258] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:04 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:05.051586 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-61677148-cd95-433d-9f29-8b14ec20c40d req-c9254ccf-bcc0-4cd8-a678-1823d37d8037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "222caa51-3279-42d1-8493-ecdaaadfd03b", "name": "network-vif-deleted", "tag": "e2ba287f-9853-42e5-92fb-e01bc233abde"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:05.064125 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-6c399d98-5d69-4810-9a79-1d9ded6d79d3 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:05.064722 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-6c399d98-5d69-4810-9a79-1d9ded6d79d3 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 222caa51-3279-42d1-8493-ecdaaadfd03b] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:05.066009 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-61677148-cd95-433d-9f29-8b14ec20c40d req-c9254ccf-bcc0-4cd8-a678-1823d37d8037 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:05.066494 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-61677148-cd95-433d-9f29-8b14ec20c40d req-c9254ccf-bcc0-4cd8-a678-1823d37d8037 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:05.066952 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-61677148-cd95-433d-9f29-8b14ec20c40d req-c9254ccf-bcc0-4cd8-a678-1823d37d8037 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:05.070807 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6c399d98-5d69-4810-9a79-1d9ded6d79d3 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:05.071264 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6c399d98-5d69-4810-9a79-1d9ded6d79d3 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:05.071693 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6c399d98-5d69-4810-9a79-1d9ded6d79d3 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:05.072446 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6c399d98-5d69-4810-9a79-1d9ded6d79d3 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:05.072935 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6c399d98-5d69-4810-9a79-1d9ded6d79d3 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:05.073366 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6c399d98-5d69-4810-9a79-1d9ded6d79d3 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:05.079339 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-61677148-cd95-433d-9f29-8b14ec20c40d req-c9254ccf-bcc0-4cd8-a678-1823d37d8037 service nova] Creating event network-vif-deleted:e2ba287f-9853-42e5-92fb-e01bc233abde for instance 222caa51-3279-42d1-8493-ecdaaadfd03b on hv-cinder-85426 Aug 24 03:32:05.085177 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-61677148-cd95-433d-9f29-8b14ec20c40d req-c9254ccf-bcc0-4cd8-a678-1823d37d8037 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037396 Aug 24 03:32:05.086531 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 127/259] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:05.141067 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-6c399d98-5d69-4810-9a79-1d9ded6d79d3 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a2e4acb9f4eab98f96e3fa3001099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82c6dd205d640a4a78c23050a8f73af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:05.149196 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-6c399d98-5d69-4810-9a79-1d9ded6d79d3 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "GET /compute/v2.1/servers/222caa51-3279-42d1-8493-ecdaaadfd03b" status: 200 len: 1461 microversion: 2.1 time: 0.089510 Aug 24 03:32:05.149774 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 133/260] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:05 2022] GET /compute/v2.1/servers/222caa51-3279-42d1-8493-ecdaaadfd03b => generated 1461 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:05.703604 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-992891ce-0f24-4f90-8d2e-f90b096fec0f tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:05.704311 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-992891ce-0f24-4f90-8d2e-f90b096fec0f tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:05.710492 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-992891ce-0f24-4f90-8d2e-f90b096fec0f tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:05.711004 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-992891ce-0f24-4f90-8d2e-f90b096fec0f tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:05.711546 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-992891ce-0f24-4f90-8d2e-f90b096fec0f tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:05.712282 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-992891ce-0f24-4f90-8d2e-f90b096fec0f tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:05.712743 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-992891ce-0f24-4f90-8d2e-f90b096fec0f tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:05.713272 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-992891ce-0f24-4f90-8d2e-f90b096fec0f tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:05.862396 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-992891ce-0f24-4f90-8d2e-f90b096fec0f tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:05.865752 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:05.874866 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-992891ce-0f24-4f90-8d2e-f90b096fec0f tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1522 microversion: 2.1 time: 0.176070 Aug 24 03:32:05.875449 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 128/261] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:05 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:06.177212 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-4b7857df-202a-435c-92c8-000a3738e4b6 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:06.178109 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-4b7857df-202a-435c-92c8-000a3738e4b6 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] [instance: 222caa51-3279-42d1-8493-ecdaaadfd03b] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:06.184200 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4b7857df-202a-435c-92c8-000a3738e4b6 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:06.184712 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4b7857df-202a-435c-92c8-000a3738e4b6 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:06.185176 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4b7857df-202a-435c-92c8-000a3738e4b6 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:06.186377 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4b7857df-202a-435c-92c8-000a3738e4b6 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:06.187085 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4b7857df-202a-435c-92c8-000a3738e4b6 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:06.187517 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4b7857df-202a-435c-92c8-000a3738e4b6 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:06.200626 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.wsgi [None req-4b7857df-202a-435c-92c8-000a3738e4b6 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] HTTP exception thrown: Instance 222caa51-3279-42d1-8493-ecdaaadfd03b could not be found. Aug 24 03:32:06.202802 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-4b7857df-202a-435c-92c8-000a3738e4b6 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Request method failure captured: Aug 24 03:32:06.202802 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: request: GET /compute/v2.1/servers/222caa51-3279-42d1-8493-ecdaaadfd03b HTTP/1.1 Aug 24 03:32:06.202802 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept: application/json Aug 24 03:32:06.202802 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept-Encoding: identity Aug 24 03:32:06.202802 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Connection: close Aug 24 03:32:06.202802 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Length: 0 Aug 24 03:32:06.202802 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Type: application/json Aug 24 03:32:06.202802 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Host: 10.222.0.81 Aug 24 03:32:06.202802 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Openstack-System-Scope: None Aug 24 03:32:06.202802 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: User-Agent: python-urllib3/1.26.11 Aug 24 03:32:06.202802 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Auth-Token: gAAAAABjBZuM0b18_jQEb2HurhsFrx9zAhpknBy656gbHBAAbMzXVKdULVQW8twGE9Op-9TtEPh-79YnDHiQPFO9RJc3x_uVzoU9q5eBI8o6gcKo3cK7A6E72_41NS9PgRRFjn4fl5XpzO9-Wja4hbp85-RhyDFMgf9wMn2GH9yYRlKEPJjC6X0 Aug 24 03:32:06.202802 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Id: None Aug 24 03:32:06.202802 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Name: None Aug 24 03:32:06.202802 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Identity-Status: Confirmed Aug 24 03:32:06.202802 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Is-Admin-Project: True Aug 24 03:32:06.202802 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Id: default Aug 24 03:32:06.202802 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Name: Default Aug 24 03:32:06.202802 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Id: f82c6dd205d640a4a78c23050a8f73af Aug 24 03:32:06.202802 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Name: tempest-VolumesActionsTest-917702961 Aug 24 03:32:06.202802 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Role: reader,member Aug 24 03:32:06.202802 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Roles: reader,member Aug 24 03:32:06.204927 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f82c6dd205d640a4a78c23050a8f73af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f82c6dd205d640a4a78c23050a8f73af", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f82c6dd205d640a4a78c23050a8f73af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f82c6dd205d640a4a78c23050a8f73af"}]}] Aug 24 03:32:06.204927 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant: tempest-VolumesActionsTest-917702961 Aug 24 03:32:06.204927 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Id: f82c6dd205d640a4a78c23050a8f73af Aug 24 03:32:06.204927 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Name: tempest-VolumesActionsTest-917702961 Aug 24 03:32:06.204927 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User: tempest-VolumesActionsTest-917702961-project Aug 24 03:32:06.204927 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Id: default Aug 24 03:32:06.204927 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Name: Default Aug 24 03:32:06.204927 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Id: ed0a2e4acb9f4eab98f96e3fa3001099 Aug 24 03:32:06.204927 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Name: tempest-VolumesActionsTest-917702961-project Aug 24 03:32:06.204927 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: method: > Aug 24 03:32:06.204927 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: exception: Instance 222caa51-3279-42d1-8493-ecdaaadfd03b could not be found. Aug 24 03:32:06.204927 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: action_args: {'id': '222caa51-3279-42d1-8493-ecdaaadfd03b'} Aug 24 03:32:06.206162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:32:06.206162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:06.206162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:32:06.206162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:32:06.206162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:32:06.206162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:32:06.206162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:32:06.206162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:32:06.206162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:32:06.206162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:32:06.206162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 222caa51-3279-42d1-8493-ecdaaadfd03b could not be found. Aug 24 03:32:06.206162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:32:06.206162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:32:06.206162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:32:06.206162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:06.206162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:32:06.206162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:32:06.206162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:32:06.206162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:32:06.206162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:32:06.208150 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:32:06.208150 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:32:06.208150 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:32:06.208150 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:32:06.208150 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:32:06.208150 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:32:06.208150 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:32:06.208150 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 222caa51-3279-42d1-8493-ecdaaadfd03b could not be found. Aug 24 03:32:06.208150 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:32:06.208150 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:32:06.208150 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:32:06.208150 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:06.208150 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:32:06.208150 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:32:06.208150 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:32:06.208150 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:32:06.208150 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 222caa51-3279-42d1-8493-ecdaaadfd03b could not be found. Aug 24 03:32:06.208150 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:32:06.209922 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-4b7857df-202a-435c-92c8-000a3738e4b6 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] Returning 404 to user: Instance 222caa51-3279-42d1-8493-ecdaaadfd03b could not be found. {{(pid=120709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:32:06.209922 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-4b7857df-202a-435c-92c8-000a3738e4b6 tempest-VolumesActionsTest-917702961 tempest-VolumesActionsTest-917702961-project] 10.222.0.81 "GET /compute/v2.1/servers/222caa51-3279-42d1-8493-ecdaaadfd03b" status: 404 len: 111 microversion: 2.1 time: 0.035136 Aug 24 03:32:06.209922 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 134/262] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:06 2022] GET /compute/v2.1/servers/222caa51-3279-42d1-8493-ecdaaadfd03b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:32:06.896431 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ace8ed75-2340-458d-9a2e-e0d6e7ca2c1e tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:06.897268 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ace8ed75-2340-458d-9a2e-e0d6e7ca2c1e tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:06.906560 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ace8ed75-2340-458d-9a2e-e0d6e7ca2c1e tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:06.907126 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ace8ed75-2340-458d-9a2e-e0d6e7ca2c1e tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:06.907567 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ace8ed75-2340-458d-9a2e-e0d6e7ca2c1e tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:06.908269 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ace8ed75-2340-458d-9a2e-e0d6e7ca2c1e tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:06.908753 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ace8ed75-2340-458d-9a2e-e0d6e7ca2c1e tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:06.909202 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ace8ed75-2340-458d-9a2e-e0d6e7ca2c1e tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:07.046869 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ace8ed75-2340-458d-9a2e-e0d6e7ca2c1e tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:07.054424 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ace8ed75-2340-458d-9a2e-e0d6e7ca2c1e tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1522 microversion: 2.1 time: 0.162511 Aug 24 03:32:07.054985 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 129/263] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:06 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:08.075791 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-2e1e265f-d536-48f5-9d87-8a2937f7e137 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:08.076552 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-2e1e265f-d536-48f5-9d87-8a2937f7e137 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:08.082758 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2e1e265f-d536-48f5-9d87-8a2937f7e137 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:08.083239 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2e1e265f-d536-48f5-9d87-8a2937f7e137 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:08.083679 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2e1e265f-d536-48f5-9d87-8a2937f7e137 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:08.084364 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2e1e265f-d536-48f5-9d87-8a2937f7e137 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:08.084845 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2e1e265f-d536-48f5-9d87-8a2937f7e137 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:08.085272 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2e1e265f-d536-48f5-9d87-8a2937f7e137 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:08.213162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-2e1e265f-d536-48f5-9d87-8a2937f7e137 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:08.221323 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-2e1e265f-d536-48f5-9d87-8a2937f7e137 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1522 microversion: 2.1 time: 0.149414 Aug 24 03:32:08.221879 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 135/264] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:08 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:09.243138 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-01e40fea-7ee3-4da0-b9dd-d39caefd58ef tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:09.243745 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-01e40fea-7ee3-4da0-b9dd-d39caefd58ef tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:09.250734 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-01e40fea-7ee3-4da0-b9dd-d39caefd58ef tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:09.251211 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-01e40fea-7ee3-4da0-b9dd-d39caefd58ef tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:09.251642 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-01e40fea-7ee3-4da0-b9dd-d39caefd58ef tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:09.252575 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-01e40fea-7ee3-4da0-b9dd-d39caefd58ef tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:09.253051 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-01e40fea-7ee3-4da0-b9dd-d39caefd58ef tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:09.253480 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-01e40fea-7ee3-4da0-b9dd-d39caefd58ef tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:09.383704 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-01e40fea-7ee3-4da0-b9dd-d39caefd58ef tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:09.391984 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-01e40fea-7ee3-4da0-b9dd-d39caefd58ef tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1522 microversion: 2.1 time: 0.152655 Aug 24 03:32:09.392544 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 130/265] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:09 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:10.413382 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-da876714-a7d0-4099-984d-469cd7dd5633 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:10.414006 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-da876714-a7d0-4099-984d-469cd7dd5633 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:10.416119 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:10.421963 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-da876714-a7d0-4099-984d-469cd7dd5633 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:10.422452 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-da876714-a7d0-4099-984d-469cd7dd5633 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:10.422897 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-da876714-a7d0-4099-984d-469cd7dd5633 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:10.423591 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-da876714-a7d0-4099-984d-469cd7dd5633 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:10.424049 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-da876714-a7d0-4099-984d-469cd7dd5633 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:10.424477 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-da876714-a7d0-4099-984d-469cd7dd5633 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:10.550197 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-da876714-a7d0-4099-984d-469cd7dd5633 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:10.557825 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-da876714-a7d0-4099-984d-469cd7dd5633 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1522 microversion: 2.1 time: 0.148652 Aug 24 03:32:10.558409 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 136/266] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:10 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:11.579355 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d81b1b53-20c9-4aca-bc8e-ed43ac5b81a7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:11.580145 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d81b1b53-20c9-4aca-bc8e-ed43ac5b81a7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:11.586523 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d81b1b53-20c9-4aca-bc8e-ed43ac5b81a7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:11.587036 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d81b1b53-20c9-4aca-bc8e-ed43ac5b81a7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:11.587443 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d81b1b53-20c9-4aca-bc8e-ed43ac5b81a7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:11.588136 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d81b1b53-20c9-4aca-bc8e-ed43ac5b81a7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:11.588618 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d81b1b53-20c9-4aca-bc8e-ed43ac5b81a7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:11.589067 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d81b1b53-20c9-4aca-bc8e-ed43ac5b81a7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:11.725904 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d81b1b53-20c9-4aca-bc8e-ed43ac5b81a7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:11.734058 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d81b1b53-20c9-4aca-bc8e-ed43ac5b81a7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1522 microversion: 2.1 time: 0.158588 Aug 24 03:32:11.734608 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 131/267] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:11 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:11.977103 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-9b92c320-15db-4ccb-a117-a9d91deae08a tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:11.983892 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9b92c320-15db-4ccb-a117-a9d91deae08a tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:11.984373 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9b92c320-15db-4ccb-a117-a9d91deae08a tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:11.984833 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9b92c320-15db-4ccb-a117-a9d91deae08a tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:12.043987 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-9b92c320-15db-4ccb-a117-a9d91deae08a tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Going to try to stop instance {{(pid=120709) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 03:32:12.086768 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-9b92c320-15db-4ccb-a117-a9d91deae08a tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "POST /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8/action" status: 202 len: 0 microversion: 2.1 time: 0.113435 Aug 24 03:32:12.087374 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 137/268] 10.222.0.81 () {60 vars in 1278 bytes} [Wed Aug 24 03:32:11 2022] POST /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:32:12.095606 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-944a8e2f-19cc-4b39-935f-33a4d09a6b8b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:12.096155 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-944a8e2f-19cc-4b39-935f-33a4d09a6b8b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:12.102014 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-944a8e2f-19cc-4b39-935f-33a4d09a6b8b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:12.102500 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-944a8e2f-19cc-4b39-935f-33a4d09a6b8b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:12.102931 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-944a8e2f-19cc-4b39-935f-33a4d09a6b8b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:12.103613 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-944a8e2f-19cc-4b39-935f-33a4d09a6b8b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:12.104067 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-944a8e2f-19cc-4b39-935f-33a4d09a6b8b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:12.104487 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-944a8e2f-19cc-4b39-935f-33a4d09a6b8b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:12.240816 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-944a8e2f-19cc-4b39-935f-33a4d09a6b8b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:12.251995 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-944a8e2f-19cc-4b39-935f-33a4d09a6b8b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1723 microversion: 2.1 time: 0.159780 Aug 24 03:32:12.256947 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 132/269] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:12 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:12.756540 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-99913462-133e-4f6f-a877-6976c311b3c1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:12.757489 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-99913462-133e-4f6f-a877-6976c311b3c1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:12.767548 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-99913462-133e-4f6f-a877-6976c311b3c1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:12.768045 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-99913462-133e-4f6f-a877-6976c311b3c1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:12.769018 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-99913462-133e-4f6f-a877-6976c311b3c1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:12.769905 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-99913462-133e-4f6f-a877-6976c311b3c1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:12.770524 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-99913462-133e-4f6f-a877-6976c311b3c1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:12.771012 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-99913462-133e-4f6f-a877-6976c311b3c1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:12.928247 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-99913462-133e-4f6f-a877-6976c311b3c1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:12.938600 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-99913462-133e-4f6f-a877-6976c311b3c1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1522 microversion: 2.1 time: 0.186414 Aug 24 03:32:12.939407 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 138/270] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:12 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:13.274379 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b47b512c-dc98-487c-bde0-533a77bf3db5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:13.275055 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-b47b512c-dc98-487c-bde0-533a77bf3db5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:13.282128 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b47b512c-dc98-487c-bde0-533a77bf3db5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:13.282842 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b47b512c-dc98-487c-bde0-533a77bf3db5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:13.283467 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b47b512c-dc98-487c-bde0-533a77bf3db5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:13.284309 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b47b512c-dc98-487c-bde0-533a77bf3db5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:13.284788 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b47b512c-dc98-487c-bde0-533a77bf3db5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:13.285227 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b47b512c-dc98-487c-bde0-533a77bf3db5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:13.450583 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-b47b512c-dc98-487c-bde0-533a77bf3db5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:13.458940 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-b47b512c-dc98-487c-bde0-533a77bf3db5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1723 microversion: 2.1 time: 0.188933 Aug 24 03:32:13.459511 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 133/271] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:13 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:13.960547 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-50d4becf-04ea-4860-b1eb-c6be30be0bbe tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:13.961819 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-50d4becf-04ea-4860-b1eb-c6be30be0bbe tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:13.969959 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-50d4becf-04ea-4860-b1eb-c6be30be0bbe tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:13.970735 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-50d4becf-04ea-4860-b1eb-c6be30be0bbe tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:13.971290 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-50d4becf-04ea-4860-b1eb-c6be30be0bbe tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:13.972162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-50d4becf-04ea-4860-b1eb-c6be30be0bbe tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:13.972617 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-50d4becf-04ea-4860-b1eb-c6be30be0bbe tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:13.973120 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-50d4becf-04ea-4860-b1eb-c6be30be0bbe tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:14.111957 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-50d4becf-04ea-4860-b1eb-c6be30be0bbe tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:14.119969 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-50d4becf-04ea-4860-b1eb-c6be30be0bbe tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1522 microversion: 2.1 time: 0.163835 Aug 24 03:32:14.120816 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 139/272] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:13 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:14.479617 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ef541f6c-f929-4d66-88c7-8b14ff798b51 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:14.480585 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ef541f6c-f929-4d66-88c7-8b14ff798b51 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:14.487783 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ef541f6c-f929-4d66-88c7-8b14ff798b51 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:14.488282 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ef541f6c-f929-4d66-88c7-8b14ff798b51 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:14.488729 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ef541f6c-f929-4d66-88c7-8b14ff798b51 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:14.489526 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ef541f6c-f929-4d66-88c7-8b14ff798b51 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:14.490134 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ef541f6c-f929-4d66-88c7-8b14ff798b51 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:14.490567 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ef541f6c-f929-4d66-88c7-8b14ff798b51 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:14.632456 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ef541f6c-f929-4d66-88c7-8b14ff798b51 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:14.642399 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ef541f6c-f929-4d66-88c7-8b14ff798b51 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1723 microversion: 2.1 time: 0.166833 Aug 24 03:32:14.642968 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 134/273] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:14 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:15.143945 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-7db565b8-7708-4298-98b7-570501f45f25 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:15.144956 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-7db565b8-7708-4298-98b7-570501f45f25 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:15.151671 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7db565b8-7708-4298-98b7-570501f45f25 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:15.152153 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7db565b8-7708-4298-98b7-570501f45f25 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:15.152596 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7db565b8-7708-4298-98b7-570501f45f25 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:15.153324 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7db565b8-7708-4298-98b7-570501f45f25 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:15.153785 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7db565b8-7708-4298-98b7-570501f45f25 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:15.154211 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7db565b8-7708-4298-98b7-570501f45f25 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:15.480331 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-7db565b8-7708-4298-98b7-570501f45f25 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:15.487931 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-7db565b8-7708-4298-98b7-570501f45f25 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1502 microversion: 2.1 time: 0.348784 Aug 24 03:32:15.488486 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 140/274] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:15 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1502 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:15.509624 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-652b1b73-9e0e-4a87-b22f-16ad7acf03fa tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef658b29-25a3-4100-b334-6672fcea59ed"}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:15.512035 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-652b1b73-9e0e-4a87-b22f-16ad7acf03fa tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:15.518455 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-652b1b73-9e0e-4a87-b22f-16ad7acf03fa tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:15.518939 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-652b1b73-9e0e-4a87-b22f-16ad7acf03fa tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:15.519370 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-652b1b73-9e0e-4a87-b22f-16ad7acf03fa tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:15.520058 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-652b1b73-9e0e-4a87-b22f-16ad7acf03fa tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:15.520510 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-652b1b73-9e0e-4a87-b22f-16ad7acf03fa tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:15.520974 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-652b1b73-9e0e-4a87-b22f-16ad7acf03fa tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:15.544556 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-652b1b73-9e0e-4a87-b22f-16ad7acf03fa tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] HTTP exception thrown: Cannot 'attach_volume' instance a844487d-f9fc-4452-843d-d6ac2efb35d6 while it is in vm_state rescued Aug 24 03:32:15.546638 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-652b1b73-9e0e-4a87-b22f-16ad7acf03fa tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Request method failure captured: Aug 24 03:32:15.546638 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: request: POST /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6/os-volume_attachments HTTP/1.1 Aug 24 03:32:15.546638 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 24 03:32:15.546638 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 24 03:32:15.546638 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Connection: close Aug 24 03:32:15.546638 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Length: 74 Aug 24 03:32:15.546638 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 24 03:32:15.546638 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Host: 10.222.0.81 Aug 24 03:32:15.546638 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 24 03:32:15.546638 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.11 Aug 24 03:32:15.546638 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjBZtELohYIAWnqjydeh3nWBVxVzNmFojSvJiXirJze4xCW5UrBoFNDSrYI2MQuwDBgKCF0rIi4_RidefSOe-gruz8glzTk9P0i0YWWK0Ls_tkgBqEsg07AX095VUNsx8SXSrVeXxD-FtuxDYQ-PAYt2BeP7o3wF-sE_NMuIwVCtJS2k0 Aug 24 03:32:15.546638 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 24 03:32:15.546638 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 24 03:32:15.546638 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 24 03:32:15.546638 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 24 03:32:15.546638 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 24 03:32:15.546638 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 24 03:32:15.546638 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Id: 625e6391470e4018a6c502219b3d2b15 Aug 24 03:32:15.546638 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1294945241 Aug 24 03:32:15.546638 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 24 03:32:15.546638 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 24 03:32:15.547963 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/625e6391470e4018a6c502219b3d2b15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_625e6391470e4018a6c502219b3d2b15", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/625e6391470e4018a6c502219b3d2b15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/625e6391470e4018a6c502219b3d2b15"}]}] Aug 24 03:32:15.547963 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1294945241 Aug 24 03:32:15.547963 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 625e6391470e4018a6c502219b3d2b15 Aug 24 03:32:15.547963 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1294945241 Aug 24 03:32:15.547963 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User: tempest-ServerRescueNegativeTestJSON-1294945241-project Aug 24 03:32:15.547963 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 24 03:32:15.547963 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 24 03:32:15.547963 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Id: 33b932f3feb342d889155c3c34407a88 Aug 24 03:32:15.547963 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1294945241-project Aug 24 03:32:15.547963 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Aug 24 03:32:15.547963 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: {"volumeAttachment": {"volumeId": "ef658b29-25a3-4100-b334-6672fcea59ed"}} Aug 24 03:32:15.547963 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: method: > Aug 24 03:32:15.548748 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: exception: Cannot 'attach_volume' instance a844487d-f9fc-4452-843d-d6ac2efb35d6 while it is in vm_state rescued Aug 24 03:32:15.548748 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: action_args: {'server_id': 'a844487d-f9fc-4452-843d-d6ac2efb35d6', 'body': {'volumeAttachment': {'volumeId': 'ef658b29-25a3-4100-b334-6672fcea59ed'}}} Aug 24 03:32:15.548748 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:32:15.548748 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:15.548748 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 03:32:15.548748 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 03:32:15.548748 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 03:32:15.548748 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:32:15.548748 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 03:32:15.548748 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 03:32:15.548748 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a844487d-f9fc-4452-843d-d6ac2efb35d6 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 03:32:15.548748 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:32:15.548748 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:32:15.548748 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:32:15.548748 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:15.548748 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:32:15.548748 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:32:15.548748 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:32:15.548748 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:32:15.550453 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:32:15.550453 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:32:15.550453 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:32:15.550453 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:32:15.550453 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:32:15.550453 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:32:15.550453 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:32:15.550453 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:32:15.550453 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 03:32:15.550453 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 03:32:15.550453 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 03:32:15.550453 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 03:32:15.550453 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance a844487d-f9fc-4452-843d-d6ac2efb35d6 while it is in vm_state rescued Aug 24 03:32:15.550453 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:32:15.550453 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:32:15.550453 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:32:15.550453 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:32:15.550453 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:32:15.550453 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:32:15.551706 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:32:15.551706 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:32:15.551706 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance a844487d-f9fc-4452-843d-d6ac2efb35d6 while it is in vm_state rescued Aug 24 03:32:15.551706 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:32:15.551706 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-652b1b73-9e0e-4a87-b22f-16ad7acf03fa tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Returning 409 to user: Cannot 'attach_volume' instance a844487d-f9fc-4452-843d-d6ac2efb35d6 while it is in vm_state rescued {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:32:15.551706 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-652b1b73-9e0e-4a87-b22f-16ad7acf03fa tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "POST /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042339 Aug 24 03:32:15.551706 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 135/275] 10.222.0.81 () {60 vars in 1323 bytes} [Wed Aug 24 03:32:15 2022] POST /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:32:15.559058 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-1df88ad1-d450-4a4c-8ca9-9aa9bfb193ac tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:15.559564 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-1df88ad1-d450-4a4c-8ca9-9aa9bfb193ac tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:15.565701 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1df88ad1-d450-4a4c-8ca9-9aa9bfb193ac tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:15.566181 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1df88ad1-d450-4a4c-8ca9-9aa9bfb193ac tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:15.566623 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1df88ad1-d450-4a4c-8ca9-9aa9bfb193ac tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:15.567310 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1df88ad1-d450-4a4c-8ca9-9aa9bfb193ac tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:15.567766 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1df88ad1-d450-4a4c-8ca9-9aa9bfb193ac tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:15.568190 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1df88ad1-d450-4a4c-8ca9-9aa9bfb193ac tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:15.679194 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-cb4b6d38-508a-4d04-9224-88ef108958c7 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:15.683453 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-cb4b6d38-508a-4d04-9224-88ef108958c7 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:15.688695 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-1df88ad1-d450-4a4c-8ca9-9aa9bfb193ac tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "POST /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6/action" status: 202 len: 0 microversion: 2.1 time: 0.134271 Aug 24 03:32:15.691695 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 141/276] 10.222.0.81 () {60 vars in 1278 bytes} [Wed Aug 24 03:32:15 2022] POST /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:32:15.706546 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cb4b6d38-508a-4d04-9224-88ef108958c7 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:15.707297 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cb4b6d38-508a-4d04-9224-88ef108958c7 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:15.707963 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cb4b6d38-508a-4d04-9224-88ef108958c7 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:15.709066 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cb4b6d38-508a-4d04-9224-88ef108958c7 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:15.709983 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cb4b6d38-508a-4d04-9224-88ef108958c7 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:15.711185 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cb4b6d38-508a-4d04-9224-88ef108958c7 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:15.717697 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-1b64c48d-f1b0-4625-9293-998c93786e99 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:15.720909 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-1b64c48d-f1b0-4625-9293-998c93786e99 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:15.735181 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1b64c48d-f1b0-4625-9293-998c93786e99 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:15.735984 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1b64c48d-f1b0-4625-9293-998c93786e99 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:15.736935 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1b64c48d-f1b0-4625-9293-998c93786e99 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:15.738931 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1b64c48d-f1b0-4625-9293-998c93786e99 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:15.740942 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1b64c48d-f1b0-4625-9293-998c93786e99 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:15.741669 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1b64c48d-f1b0-4625-9293-998c93786e99 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:16.094412 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-cb4b6d38-508a-4d04-9224-88ef108958c7 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:16.103847 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-cb4b6d38-508a-4d04-9224-88ef108958c7 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1723 microversion: 2.1 time: 0.431701 Aug 24 03:32:16.105084 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 136/277] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:15 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1723 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:16.125286 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-1b64c48d-f1b0-4625-9293-998c93786e99 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:16.134648 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-1b64c48d-f1b0-4625-9293-998c93786e99 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1510 microversion: 2.1 time: 0.433477 Aug 24 03:32:16.139945 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 142/278] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:15 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1510 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:17.136935 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-6e66d99d-7e85-4442-bd7e-2cd5fe9243ea tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:17.137556 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-6e66d99d-7e85-4442-bd7e-2cd5fe9243ea tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:17.144323 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6e66d99d-7e85-4442-bd7e-2cd5fe9243ea tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:17.145079 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6e66d99d-7e85-4442-bd7e-2cd5fe9243ea tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:17.145732 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6e66d99d-7e85-4442-bd7e-2cd5fe9243ea tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:17.146627 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6e66d99d-7e85-4442-bd7e-2cd5fe9243ea tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:17.147083 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6e66d99d-7e85-4442-bd7e-2cd5fe9243ea tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:17.147535 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6e66d99d-7e85-4442-bd7e-2cd5fe9243ea tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:17.155768 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-b8920c41-0332-4405-b6a0-f9c1007a5b7d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:17.157158 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-b8920c41-0332-4405-b6a0-f9c1007a5b7d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:17.167084 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b8920c41-0332-4405-b6a0-f9c1007a5b7d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:17.171753 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b8920c41-0332-4405-b6a0-f9c1007a5b7d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:17.172401 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b8920c41-0332-4405-b6a0-f9c1007a5b7d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:17.173337 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b8920c41-0332-4405-b6a0-f9c1007a5b7d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:17.173997 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b8920c41-0332-4405-b6a0-f9c1007a5b7d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:17.174418 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b8920c41-0332-4405-b6a0-f9c1007a5b7d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:17.469802 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-6e66d99d-7e85-4442-bd7e-2cd5fe9243ea tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:17.472368 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-b8920c41-0332-4405-b6a0-f9c1007a5b7d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:17.481586 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-b8920c41-0332-4405-b6a0-f9c1007a5b7d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1510 microversion: 2.1 time: 0.329563 Aug 24 03:32:17.482331 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 143/279] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:17 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1510 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:17.490901 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-6e66d99d-7e85-4442-bd7e-2cd5fe9243ea tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1723 microversion: 2.1 time: 0.367775 Aug 24 03:32:17.500822 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 137/280] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:17 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1723 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:18.512856 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-c0123b29-cade-4172-b281-8d329ddca3ae tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:18.514568 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-c0123b29-cade-4172-b281-8d329ddca3ae tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:18.515686 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f23331ff-f484-4d42-b198-1cfce633dd7e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:18.516823 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f23331ff-f484-4d42-b198-1cfce633dd7e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:18.519631 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=72 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:18.530197 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c0123b29-cade-4172-b281-8d329ddca3ae tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:18.530426 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f23331ff-f484-4d42-b198-1cfce633dd7e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:18.530823 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f23331ff-f484-4d42-b198-1cfce633dd7e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:18.531449 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c0123b29-cade-4172-b281-8d329ddca3ae tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:18.531579 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f23331ff-f484-4d42-b198-1cfce633dd7e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:18.532204 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f23331ff-f484-4d42-b198-1cfce633dd7e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:18.532308 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c0123b29-cade-4172-b281-8d329ddca3ae tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:18.532681 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f23331ff-f484-4d42-b198-1cfce633dd7e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:18.533586 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c0123b29-cade-4172-b281-8d329ddca3ae tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:18.534711 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c0123b29-cade-4172-b281-8d329ddca3ae tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:18.535332 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c0123b29-cade-4172-b281-8d329ddca3ae tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:18.536000 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f23331ff-f484-4d42-b198-1cfce633dd7e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:18.567178 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:18.754879 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f23331ff-f484-4d42-b198-1cfce633dd7e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:18.770762 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f23331ff-f484-4d42-b198-1cfce633dd7e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1723 microversion: 2.1 time: 0.259091 Aug 24 03:32:18.784792 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 138/281] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:18 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:18.785140 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-c0123b29-cade-4172-b281-8d329ddca3ae tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:18.795853 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-c0123b29-cade-4172-b281-8d329ddca3ae tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1510 microversion: 2.1 time: 0.289135 Aug 24 03:32:18.796426 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 144/282] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:18 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1510 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:19.794278 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-fd676b68-1ee7-4507-9f1c-42726bf97c5d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:19.794892 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-fd676b68-1ee7-4507-9f1c-42726bf97c5d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:19.803288 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fd676b68-1ee7-4507-9f1c-42726bf97c5d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:19.803871 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fd676b68-1ee7-4507-9f1c-42726bf97c5d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:19.804381 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fd676b68-1ee7-4507-9f1c-42726bf97c5d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:19.805197 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fd676b68-1ee7-4507-9f1c-42726bf97c5d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:19.805862 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fd676b68-1ee7-4507-9f1c-42726bf97c5d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:19.806695 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fd676b68-1ee7-4507-9f1c-42726bf97c5d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:19.818440 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-d9494818-1fa4-4719-b477-6cbf955ab439 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:19.819050 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-d9494818-1fa4-4719-b477-6cbf955ab439 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:19.827323 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d9494818-1fa4-4719-b477-6cbf955ab439 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:19.839735 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d9494818-1fa4-4719-b477-6cbf955ab439 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:19.842096 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d9494818-1fa4-4719-b477-6cbf955ab439 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:19.843087 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d9494818-1fa4-4719-b477-6cbf955ab439 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:19.844686 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d9494818-1fa4-4719-b477-6cbf955ab439 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:19.847160 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d9494818-1fa4-4719-b477-6cbf955ab439 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:20.041470 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-fd676b68-1ee7-4507-9f1c-42726bf97c5d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:20.043563 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-d9494818-1fa4-4719-b477-6cbf955ab439 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:20.051962 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-fd676b68-1ee7-4507-9f1c-42726bf97c5d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1723 microversion: 2.1 time: 0.262495 Aug 24 03:32:20.053157 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 139/283] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:19 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:20.053283 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-d9494818-1fa4-4719-b477-6cbf955ab439 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1510 microversion: 2.1 time: 0.238501 Aug 24 03:32:20.054801 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 145/284] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:19 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1510 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:21.079992 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-50daf786-b80d-4848-9a80-199609c7044f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:21.081166 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-f012f284-b50f-48cd-ae6a-2e73ee8ebe75 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:21.081766 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-f012f284-b50f-48cd-ae6a-2e73ee8ebe75 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:21.083531 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-50daf786-b80d-4848-9a80-199609c7044f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:21.094400 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f012f284-b50f-48cd-ae6a-2e73ee8ebe75 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:21.096117 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-50daf786-b80d-4848-9a80-199609c7044f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:21.097063 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f012f284-b50f-48cd-ae6a-2e73ee8ebe75 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:21.097763 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-50daf786-b80d-4848-9a80-199609c7044f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:21.098388 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f012f284-b50f-48cd-ae6a-2e73ee8ebe75 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:21.099006 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-50daf786-b80d-4848-9a80-199609c7044f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:21.099905 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f012f284-b50f-48cd-ae6a-2e73ee8ebe75 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:21.100362 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f012f284-b50f-48cd-ae6a-2e73ee8ebe75 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:21.101639 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-50daf786-b80d-4848-9a80-199609c7044f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:21.102645 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-50daf786-b80d-4848-9a80-199609c7044f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:21.103062 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-50daf786-b80d-4848-9a80-199609c7044f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:21.103271 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f012f284-b50f-48cd-ae6a-2e73ee8ebe75 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:21.338936 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-50daf786-b80d-4848-9a80-199609c7044f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:21.342986 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-f012f284-b50f-48cd-ae6a-2e73ee8ebe75 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:21.358842 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-f012f284-b50f-48cd-ae6a-2e73ee8ebe75 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1510 microversion: 2.1 time: 0.285950 Aug 24 03:32:21.359426 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 146/285] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:21 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1510 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:21.361262 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-50daf786-b80d-4848-9a80-199609c7044f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1723 microversion: 2.1 time: 0.289701 Aug 24 03:32:21.368717 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 140/286] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:21 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1723 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:22.385194 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-cfd19143-da29-4b8a-a84c-09aecef6de1c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:22.386506 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-cfd19143-da29-4b8a-a84c-09aecef6de1c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:22.400472 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-e715d51f-cf6c-4fb3-bfcd-b385a44cc378 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:22.401697 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-e715d51f-cf6c-4fb3-bfcd-b385a44cc378 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:22.425716 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e715d51f-cf6c-4fb3-bfcd-b385a44cc378 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:22.428600 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cfd19143-da29-4b8a-a84c-09aecef6de1c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:22.429411 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cfd19143-da29-4b8a-a84c-09aecef6de1c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:22.430619 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cfd19143-da29-4b8a-a84c-09aecef6de1c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:22.431386 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e715d51f-cf6c-4fb3-bfcd-b385a44cc378 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:22.432038 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e715d51f-cf6c-4fb3-bfcd-b385a44cc378 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:22.433014 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cfd19143-da29-4b8a-a84c-09aecef6de1c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:22.435799 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cfd19143-da29-4b8a-a84c-09aecef6de1c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:22.436931 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e715d51f-cf6c-4fb3-bfcd-b385a44cc378 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:22.437643 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e715d51f-cf6c-4fb3-bfcd-b385a44cc378 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:22.438300 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cfd19143-da29-4b8a-a84c-09aecef6de1c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:22.439896 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e715d51f-cf6c-4fb3-bfcd-b385a44cc378 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:22.728119 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-e715d51f-cf6c-4fb3-bfcd-b385a44cc378 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:22.730968 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-cfd19143-da29-4b8a-a84c-09aecef6de1c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:22.740959 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-cfd19143-da29-4b8a-a84c-09aecef6de1c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1723 microversion: 2.1 time: 0.361609 Aug 24 03:32:22.742484 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-e715d51f-cf6c-4fb3-bfcd-b385a44cc378 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1516 microversion: 2.1 time: 0.351939 Aug 24 03:32:22.744969 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 141/287] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:22 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1516 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:22.756185 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 147/288] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:22 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1723 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:23.763470 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-cca26d7e-c715-4106-9f47-f4dddb7a2b0d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:23.763997 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-cca26d7e-c715-4106-9f47-f4dddb7a2b0d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:23.771684 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cca26d7e-c715-4106-9f47-f4dddb7a2b0d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:23.772511 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cca26d7e-c715-4106-9f47-f4dddb7a2b0d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:23.773289 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cca26d7e-c715-4106-9f47-f4dddb7a2b0d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:23.774071 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cca26d7e-c715-4106-9f47-f4dddb7a2b0d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:23.774627 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cca26d7e-c715-4106-9f47-f4dddb7a2b0d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:23.775188 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cca26d7e-c715-4106-9f47-f4dddb7a2b0d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:23.920988 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-cca26d7e-c715-4106-9f47-f4dddb7a2b0d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:23.929487 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-cca26d7e-c715-4106-9f47-f4dddb7a2b0d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1723 microversion: 2.1 time: 0.169919 Aug 24 03:32:23.930066 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 142/289] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:23 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:24.954345 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-5934c432-8998-4bad-bcfa-591087586167 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:24.955009 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-5934c432-8998-4bad-bcfa-591087586167 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:24.965965 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5934c432-8998-4bad-bcfa-591087586167 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:24.966737 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5934c432-8998-4bad-bcfa-591087586167 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:24.967483 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5934c432-8998-4bad-bcfa-591087586167 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:24.968825 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5934c432-8998-4bad-bcfa-591087586167 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:24.970472 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5934c432-8998-4bad-bcfa-591087586167 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:24.971566 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5934c432-8998-4bad-bcfa-591087586167 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:25.133081 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-5934c432-8998-4bad-bcfa-591087586167 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:25.143330 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-5934c432-8998-4bad-bcfa-591087586167 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1723 microversion: 2.1 time: 0.196074 Aug 24 03:32:25.149131 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 148/290] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:24 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:25.458879 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4dda5b45-60b2-4988-9f44-c8dadb4d4543 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Action: 'create', calling method: .version_select at 0x7f942ffb9670>, body: {"keypair": {"name": "tempest-keypair-356678355", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyGxLvTSb5bmwnP/yGoJ3wpKFNuuk/gjV3oHiifqH4M0ozHBgnywRrnHZs3VyzNbDWG2Fm2A5355EyaDuhRS6t4W/Kpqm4/G5sJD/3Dz6sTWhOgm3NYQG8/MBav8fiC9w=="}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:25.477937 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-4dda5b45-60b2-4988-9f44-c8dadb4d4543 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Getting quotas for project 625e6391470e4018a6c502219b3d2b15. Resources: {'key_pairs'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:32:25.482212 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-4dda5b45-60b2-4988-9f44-c8dadb4d4543 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Getting quotas for user 33b932f3feb342d889155c3c34407a88 and project 625e6391470e4018a6c502219b3d2b15. Resources: {'key_pairs'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:32:25.512508 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4dda5b45-60b2-4988-9f44-c8dadb4d4543 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057781 Aug 24 03:32:25.519804 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 143/291] 10.222.0.81 () {60 vars in 1159 bytes} [Wed Aug 24 03:32:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:26.165759 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-205405a9-fd59-4b62-bbeb-e4f6c114ff8c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:26.166542 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-205405a9-fd59-4b62-bbeb-e4f6c114ff8c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:26.175961 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-205405a9-fd59-4b62-bbeb-e4f6c114ff8c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:26.180009 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-205405a9-fd59-4b62-bbeb-e4f6c114ff8c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:26.180680 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-205405a9-fd59-4b62-bbeb-e4f6c114ff8c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:26.183010 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-205405a9-fd59-4b62-bbeb-e4f6c114ff8c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:26.184525 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-205405a9-fd59-4b62-bbeb-e4f6c114ff8c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:26.186475 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-205405a9-fd59-4b62-bbeb-e4f6c114ff8c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:26.543623 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-205405a9-fd59-4b62-bbeb-e4f6c114ff8c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:26.557184 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-205405a9-fd59-4b62-bbeb-e4f6c114ff8c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1723 microversion: 2.1 time: 0.395434 Aug 24 03:32:26.558775 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 149/292] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:26 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1723 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:27.580879 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-659c180d-b88d-4658-8e33-92dcbc02189b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:27.584475 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-659c180d-b88d-4658-8e33-92dcbc02189b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:27.598418 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-659c180d-b88d-4658-8e33-92dcbc02189b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:27.599433 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-659c180d-b88d-4658-8e33-92dcbc02189b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:27.601391 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-659c180d-b88d-4658-8e33-92dcbc02189b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:27.602744 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-659c180d-b88d-4658-8e33-92dcbc02189b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:27.603759 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-659c180d-b88d-4658-8e33-92dcbc02189b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:27.604538 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-659c180d-b88d-4658-8e33-92dcbc02189b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:27.656628 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-5ed03339-2a81-4fcb-8ddb-3a814848f0e5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1826872068", "imageRef": "b7a40f0c-20c2-44cd-8b0e-f6e73a007d3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2fad991f-cb6d-4aa1-a780-e38bbcc632a1"}], "security_groups": [{"name": "tempest-securitygroup--717707281"}], "key_name": "tempest-keypair-356678355", "user_data": "}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:27.837099 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-659c180d-b88d-4658-8e33-92dcbc02189b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:27.849828 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-659c180d-b88d-4658-8e33-92dcbc02189b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1723 microversion: 2.1 time: 0.274524 Aug 24 03:32:27.850410 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 144/293] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:27 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1723 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:27.850821 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.network.neutron [None req-5ed03339-2a81-4fcb-8ddb-3a814848f0e5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] validate_networks() for [('2fad991f-cb6d-4aa1-a780-e38bbcc632a1', None, None, None, None, None)] {{(pid=120709) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:32:28.319347 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-5ed03339-2a81-4fcb-8ddb-3a814848f0e5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Flavor limits 0:0:0 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:32:28.319775 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-5ed03339-2a81-4fcb-8ddb-3a814848f0e5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Image limits 0:0:0 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:32:28.320266 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-5ed03339-2a81-4fcb-8ddb-3a814848f0e5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Flavor pref 0:0:0 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:32:28.320692 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-5ed03339-2a81-4fcb-8ddb-3a814848f0e5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Image pref 0:0:0 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:32:28.321147 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-5ed03339-2a81-4fcb-8ddb-3a814848f0e5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:32:28.329992 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5ed03339-2a81-4fcb-8ddb-3a814848f0e5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:28.330517 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5ed03339-2a81-4fcb-8ddb-3a814848f0e5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:28.331055 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5ed03339-2a81-4fcb-8ddb-3a814848f0e5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:28.331862 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5ed03339-2a81-4fcb-8ddb-3a814848f0e5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:28.332314 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5ed03339-2a81-4fcb-8ddb-3a814848f0e5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:28.332734 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5ed03339-2a81-4fcb-8ddb-3a814848f0e5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:28.354500 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.quota [None req-5ed03339-2a81-4fcb-8ddb-3a814848f0e5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Getting quotas for project 625e6391470e4018a6c502219b3d2b15. Resources: {'ram', 'instances', 'cores'} {{(pid=120709) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:32:28.359810 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.quota [None req-5ed03339-2a81-4fcb-8ddb-3a814848f0e5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Getting quotas for user 33b932f3feb342d889155c3c34407a88 and project 625e6391470e4018a6c502219b3d2b15. Resources: {'ram', 'instances', 'cores'} {{(pid=120709) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:32:28.375916 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-5ed03339-2a81-4fcb-8ddb-3a814848f0e5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Going to run 1 instances... {{(pid=120709) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:32:28.378237 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-5ed03339-2a81-4fcb-8ddb-3a814848f0e5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b7a40f0c-20c2-44cd-8b0e-f6e73a007d3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120709) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:32:28.429291 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-5ed03339-2a81-4fcb-8ddb-3a814848f0e5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.777661 Aug 24 03:32:28.436637 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 150/294] 10.222.0.81 () {60 vars in 1147 bytes} [Wed Aug 24 03:32:27 2022] POST /compute/v2.1/servers => generated 408 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:32:28.442202 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d4002bf9-bc83-4dd6-9f69-2c394ef90f97 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:28.443929 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d4002bf9-bc83-4dd6-9f69-2c394ef90f97 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:28.527084 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d4002bf9-bc83-4dd6-9f69-2c394ef90f97 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:28.534507 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d4002bf9-bc83-4dd6-9f69-2c394ef90f97 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1245 microversion: 2.1 time: 0.096174 Aug 24 03:32:28.550054 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 145/295] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:28 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1245 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:28.874031 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-4345d21e-3028-447b-8611-e01bf9455815 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:28.874917 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-4345d21e-3028-447b-8611-e01bf9455815 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:28.883576 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4345d21e-3028-447b-8611-e01bf9455815 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:28.884368 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4345d21e-3028-447b-8611-e01bf9455815 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:28.885255 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4345d21e-3028-447b-8611-e01bf9455815 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:28.886214 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4345d21e-3028-447b-8611-e01bf9455815 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:28.886931 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4345d21e-3028-447b-8611-e01bf9455815 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:28.887570 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4345d21e-3028-447b-8611-e01bf9455815 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:29.058929 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-4345d21e-3028-447b-8611-e01bf9455815 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:29.068992 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-4345d21e-3028-447b-8611-e01bf9455815 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1723 microversion: 2.1 time: 0.199379 Aug 24 03:32:29.070662 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 151/296] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:28 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:29.559834 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-bae7eadc-ba38-4a3d-8651-b51b22b557a1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:29.560695 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-bae7eadc-ba38-4a3d-8651-b51b22b557a1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:29.570000 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bae7eadc-ba38-4a3d-8651-b51b22b557a1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:29.570506 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bae7eadc-ba38-4a3d-8651-b51b22b557a1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:29.571122 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bae7eadc-ba38-4a3d-8651-b51b22b557a1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:29.572101 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bae7eadc-ba38-4a3d-8651-b51b22b557a1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:29.572880 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bae7eadc-ba38-4a3d-8651-b51b22b557a1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:29.573368 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bae7eadc-ba38-4a3d-8651-b51b22b557a1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:29.646133 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-bae7eadc-ba38-4a3d-8651-b51b22b557a1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:29.655865 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-bae7eadc-ba38-4a3d-8651-b51b22b557a1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1249 microversion: 2.1 time: 0.100416 Aug 24 03:32:29.657180 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 146/297] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:29 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1249 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:30.092244 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-450dba31-8015-4bdb-9e21-7955bcff3d44 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:30.095664 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-450dba31-8015-4bdb-9e21-7955bcff3d44 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:30.101979 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-450dba31-8015-4bdb-9e21-7955bcff3d44 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:30.102695 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-450dba31-8015-4bdb-9e21-7955bcff3d44 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:30.103309 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-450dba31-8015-4bdb-9e21-7955bcff3d44 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:30.104029 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-450dba31-8015-4bdb-9e21-7955bcff3d44 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:30.104489 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-450dba31-8015-4bdb-9e21-7955bcff3d44 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:30.104957 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-450dba31-8015-4bdb-9e21-7955bcff3d44 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:30.287416 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-450dba31-8015-4bdb-9e21-7955bcff3d44 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:30.298946 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-450dba31-8015-4bdb-9e21-7955bcff3d44 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1723 microversion: 2.1 time: 0.210518 Aug 24 03:32:30.299468 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 152/298] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:30 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:30.678469 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-afa4c259-e0a9-4508-8513-fcc2a50e4ec7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:30.680429 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-afa4c259-e0a9-4508-8513-fcc2a50e4ec7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:30.689231 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-afa4c259-e0a9-4508-8513-fcc2a50e4ec7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:30.689972 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-afa4c259-e0a9-4508-8513-fcc2a50e4ec7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:30.690512 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-afa4c259-e0a9-4508-8513-fcc2a50e4ec7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:30.691904 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-afa4c259-e0a9-4508-8513-fcc2a50e4ec7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:30.693477 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-afa4c259-e0a9-4508-8513-fcc2a50e4ec7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:30.694626 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-afa4c259-e0a9-4508-8513-fcc2a50e4ec7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:30.778926 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-afa4c259-e0a9-4508-8513-fcc2a50e4ec7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:30.781667 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=100 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:30.792339 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-afa4c259-e0a9-4508-8513-fcc2a50e4ec7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1241 microversion: 2.1 time: 0.119508 Aug 24 03:32:30.793538 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 147/299] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:30 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1241 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:31.323454 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-6822cd7a-0d5e-44f0-821a-993dca60a05f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:31.324094 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-6822cd7a-0d5e-44f0-821a-993dca60a05f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:31.330127 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6822cd7a-0d5e-44f0-821a-993dca60a05f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:31.330893 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6822cd7a-0d5e-44f0-821a-993dca60a05f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:31.331650 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6822cd7a-0d5e-44f0-821a-993dca60a05f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:31.332416 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6822cd7a-0d5e-44f0-821a-993dca60a05f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:31.333140 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6822cd7a-0d5e-44f0-821a-993dca60a05f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:31.336172 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6822cd7a-0d5e-44f0-821a-993dca60a05f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:31.508493 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-6822cd7a-0d5e-44f0-821a-993dca60a05f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:31.524142 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-6822cd7a-0d5e-44f0-821a-993dca60a05f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1723 microversion: 2.1 time: 0.204621 Aug 24 03:32:31.525298 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 153/300] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:31 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:31.814587 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-841bb963-145a-4e96-aa19-25720e2e38f1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:31.815195 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-841bb963-145a-4e96-aa19-25720e2e38f1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:31.822321 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-841bb963-145a-4e96-aa19-25720e2e38f1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:31.823061 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-841bb963-145a-4e96-aa19-25720e2e38f1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:31.823776 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-841bb963-145a-4e96-aa19-25720e2e38f1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:31.824650 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-841bb963-145a-4e96-aa19-25720e2e38f1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:31.825133 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-841bb963-145a-4e96-aa19-25720e2e38f1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:31.825559 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-841bb963-145a-4e96-aa19-25720e2e38f1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:31.902308 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-841bb963-145a-4e96-aa19-25720e2e38f1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:31.911992 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-841bb963-145a-4e96-aa19-25720e2e38f1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1297 microversion: 2.1 time: 0.101106 Aug 24 03:32:31.912578 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 148/301] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:31 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1297 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:32.550163 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-2d0e760e-55a3-4428-ad99-8eb43e095e49 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:32.550887 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-2d0e760e-55a3-4428-ad99-8eb43e095e49 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:32.557192 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2d0e760e-55a3-4428-ad99-8eb43e095e49 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:32.557678 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2d0e760e-55a3-4428-ad99-8eb43e095e49 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:32.558190 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2d0e760e-55a3-4428-ad99-8eb43e095e49 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:32.558808 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2d0e760e-55a3-4428-ad99-8eb43e095e49 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:32.559264 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2d0e760e-55a3-4428-ad99-8eb43e095e49 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:32.559691 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2d0e760e-55a3-4428-ad99-8eb43e095e49 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:32.687220 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-2d0e760e-55a3-4428-ad99-8eb43e095e49 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:32.695671 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-2d0e760e-55a3-4428-ad99-8eb43e095e49 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1723 microversion: 2.1 time: 0.149771 Aug 24 03:32:32.696232 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 154/302] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:32 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:32.937694 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-5514a423-6f46-491c-abdc-4b37d9671e2a tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:32.938300 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-5514a423-6f46-491c-abdc-4b37d9671e2a tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:32.945328 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5514a423-6f46-491c-abdc-4b37d9671e2a tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:32.945808 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5514a423-6f46-491c-abdc-4b37d9671e2a tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:32.946239 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5514a423-6f46-491c-abdc-4b37d9671e2a tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:32.946920 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5514a423-6f46-491c-abdc-4b37d9671e2a tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:32.947445 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5514a423-6f46-491c-abdc-4b37d9671e2a tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:32.947770 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5514a423-6f46-491c-abdc-4b37d9671e2a tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:33.013364 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-5514a423-6f46-491c-abdc-4b37d9671e2a tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:33.021474 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-5514a423-6f46-491c-abdc-4b37d9671e2a tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1297 microversion: 2.1 time: 0.087607 Aug 24 03:32:33.022019 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 149/303] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:32 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1297 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:33.717591 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-1fc9bf6e-e874-437b-8128-0e5b689957fa tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:33.718106 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-1fc9bf6e-e874-437b-8128-0e5b689957fa tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:33.724606 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1fc9bf6e-e874-437b-8128-0e5b689957fa tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:33.725135 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1fc9bf6e-e874-437b-8128-0e5b689957fa tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:33.725580 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1fc9bf6e-e874-437b-8128-0e5b689957fa tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:33.726272 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1fc9bf6e-e874-437b-8128-0e5b689957fa tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:33.726754 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1fc9bf6e-e874-437b-8128-0e5b689957fa tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:33.727182 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1fc9bf6e-e874-437b-8128-0e5b689957fa tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:33.858776 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-1fc9bf6e-e874-437b-8128-0e5b689957fa tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:33.867933 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-1fc9bf6e-e874-437b-8128-0e5b689957fa tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1723 microversion: 2.1 time: 0.154327 Aug 24 03:32:33.868489 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 155/304] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:33 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:34.042454 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0c068b68-227b-4131-b10e-1e1d64de843d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:34.043064 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0c068b68-227b-4131-b10e-1e1d64de843d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:34.049206 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0c068b68-227b-4131-b10e-1e1d64de843d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:34.049689 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0c068b68-227b-4131-b10e-1e1d64de843d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:34.050124 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0c068b68-227b-4131-b10e-1e1d64de843d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:34.050983 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0c068b68-227b-4131-b10e-1e1d64de843d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:34.051624 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0c068b68-227b-4131-b10e-1e1d64de843d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:34.052053 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0c068b68-227b-4131-b10e-1e1d64de843d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:34.115742 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0c068b68-227b-4131-b10e-1e1d64de843d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:34.124124 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0c068b68-227b-4131-b10e-1e1d64de843d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1305 microversion: 2.1 time: 0.085299 Aug 24 03:32:34.124904 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 150/305] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:34 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1305 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:34.889559 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-273625d2-2877-4d87-8a37-fa97fe543770 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:34.890294 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-273625d2-2877-4d87-8a37-fa97fe543770 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:34.897169 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-273625d2-2877-4d87-8a37-fa97fe543770 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:34.897657 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-273625d2-2877-4d87-8a37-fa97fe543770 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:34.898086 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-273625d2-2877-4d87-8a37-fa97fe543770 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:34.898779 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-273625d2-2877-4d87-8a37-fa97fe543770 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:34.899236 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-273625d2-2877-4d87-8a37-fa97fe543770 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:34.899817 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-273625d2-2877-4d87-8a37-fa97fe543770 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:35.095923 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-273625d2-2877-4d87-8a37-fa97fe543770 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:35.121376 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-273625d2-2877-4d87-8a37-fa97fe543770 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1700 microversion: 2.1 time: 0.231185 Aug 24 03:32:35.122028 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 156/306] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:34 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1700 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:35.144701 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d1630424-879c-47a7-a87f-171a605ec885 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:35.145986 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-2ab5e571-d64e-4837-9ae4-58993ab68c39 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:35.146604 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-2ab5e571-d64e-4837-9ae4-58993ab68c39 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:35.155287 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d1630424-879c-47a7-a87f-171a605ec885 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:35.155929 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2ab5e571-d64e-4837-9ae4-58993ab68c39 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:35.156232 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d1630424-879c-47a7-a87f-171a605ec885 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:35.156417 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2ab5e571-d64e-4837-9ae4-58993ab68c39 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:35.156865 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2ab5e571-d64e-4837-9ae4-58993ab68c39 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:35.157082 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d1630424-879c-47a7-a87f-171a605ec885 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:35.157950 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2ab5e571-d64e-4837-9ae4-58993ab68c39 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:35.158040 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2ab5e571-d64e-4837-9ae4-58993ab68c39 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:35.158526 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2ab5e571-d64e-4837-9ae4-58993ab68c39 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:35.238749 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d1630424-879c-47a7-a87f-171a605ec885 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Going to try to start instance {{(pid=120708) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 03:32:35.316789 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d1630424-879c-47a7-a87f-171a605ec885 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "POST /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8/action" status: 202 len: 0 microversion: 2.1 time: 0.177453 Aug 24 03:32:35.321069 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 151/307] 10.222.0.81 () {60 vars in 1278 bytes} [Wed Aug 24 03:32:35 2022] POST /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:32:35.331722 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-691cec6c-dd90-4cf0-b8ab-4bdfedc8c2da tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:35.332813 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-691cec6c-dd90-4cf0-b8ab-4bdfedc8c2da tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:35.349433 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-691cec6c-dd90-4cf0-b8ab-4bdfedc8c2da tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:35.350145 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-691cec6c-dd90-4cf0-b8ab-4bdfedc8c2da tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:35.350833 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-691cec6c-dd90-4cf0-b8ab-4bdfedc8c2da tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:35.351316 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-691cec6c-dd90-4cf0-b8ab-4bdfedc8c2da tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:35.351816 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-691cec6c-dd90-4cf0-b8ab-4bdfedc8c2da tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:35.356655 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-691cec6c-dd90-4cf0-b8ab-4bdfedc8c2da tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:35.486936 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-2ab5e571-d64e-4837-9ae4-58993ab68c39 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:35.500985 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-2ab5e571-d64e-4837-9ae4-58993ab68c39 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1370 microversion: 2.1 time: 0.359098 Aug 24 03:32:35.513188 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 157/308] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:35 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1370 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:35.626583 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-691cec6c-dd90-4cf0-b8ab-4bdfedc8c2da tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:35.636411 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-691cec6c-dd90-4cf0-b8ab-4bdfedc8c2da tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1709 microversion: 2.1 time: 0.311480 Aug 24 03:32:35.637993 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 152/309] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:35 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1709 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:35.985503 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-88bb23c2-6a83-4495-9501-d6463e8dc7c4 req-59387b6d-5d46-4df1-9472-985c7e216b00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76a6c958-f0bd-4b52-ab2c-15ff7e7b1280", "tag": "7def1576-8e43-41f3-b534-e7a7b46f1b54"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:35.995890 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-88bb23c2-6a83-4495-9501-d6463e8dc7c4 req-59387b6d-5d46-4df1-9472-985c7e216b00 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:35.996803 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-88bb23c2-6a83-4495-9501-d6463e8dc7c4 req-59387b6d-5d46-4df1-9472-985c7e216b00 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:35.997493 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-88bb23c2-6a83-4495-9501-d6463e8dc7c4 req-59387b6d-5d46-4df1-9472-985c7e216b00 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:36.010458 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-88bb23c2-6a83-4495-9501-d6463e8dc7c4 req-59387b6d-5d46-4df1-9472-985c7e216b00 service nova] Creating event network-changed:7def1576-8e43-41f3-b534-e7a7b46f1b54 for instance 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 on hv-cinder-85426 Aug 24 03:32:36.015931 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-88bb23c2-6a83-4495-9501-d6463e8dc7c4 req-59387b6d-5d46-4df1-9472-985c7e216b00 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034135 Aug 24 03:32:36.016751 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 158/310] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:36.523706 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-31c0fc52-403c-4df9-abc1-d39640134ebc tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:36.524933 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-31c0fc52-403c-4df9-abc1-d39640134ebc tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:36.531547 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-31c0fc52-403c-4df9-abc1-d39640134ebc tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:36.532032 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-31c0fc52-403c-4df9-abc1-d39640134ebc tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:36.532460 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-31c0fc52-403c-4df9-abc1-d39640134ebc tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:36.533177 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-31c0fc52-403c-4df9-abc1-d39640134ebc tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:36.533964 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-31c0fc52-403c-4df9-abc1-d39640134ebc tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:36.534081 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-31c0fc52-403c-4df9-abc1-d39640134ebc tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:36.664552 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-3a82ec26-a12d-431f-ab65-ce77abc7badf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:36.665315 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-3a82ec26-a12d-431f-ab65-ce77abc7badf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:36.671282 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3a82ec26-a12d-431f-ab65-ce77abc7badf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:36.671771 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3a82ec26-a12d-431f-ab65-ce77abc7badf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:36.672214 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3a82ec26-a12d-431f-ab65-ce77abc7badf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:36.672946 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3a82ec26-a12d-431f-ab65-ce77abc7badf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:36.673406 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3a82ec26-a12d-431f-ab65-ce77abc7badf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:36.673834 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3a82ec26-a12d-431f-ab65-ce77abc7badf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:36.692539 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-31c0fc52-403c-4df9-abc1-d39640134ebc tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:36.700383 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-31c0fc52-403c-4df9-abc1-d39640134ebc tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1370 microversion: 2.1 time: 0.181734 Aug 24 03:32:36.701110 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 153/311] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:36 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1370 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:36.812248 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-3a82ec26-a12d-431f-ab65-ce77abc7badf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:36.820982 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-3a82ec26-a12d-431f-ab65-ce77abc7badf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1709 microversion: 2.1 time: 0.160644 Aug 24 03:32:36.821558 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 159/312] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:36 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1709 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:37.726552 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7df92c2b-7cf7-4176-afa8-a762ee5910c9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:37.727453 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-7df92c2b-7cf7-4176-afa8-a762ee5910c9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:37.734934 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7df92c2b-7cf7-4176-afa8-a762ee5910c9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:37.735453 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7df92c2b-7cf7-4176-afa8-a762ee5910c9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:37.736088 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7df92c2b-7cf7-4176-afa8-a762ee5910c9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:37.738464 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7df92c2b-7cf7-4176-afa8-a762ee5910c9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:37.739021 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7df92c2b-7cf7-4176-afa8-a762ee5910c9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:37.739527 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7df92c2b-7cf7-4176-afa8-a762ee5910c9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:37.843556 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-88b56979-88ce-45f9-8e7b-429e5a464387 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:37.844185 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-88b56979-88ce-45f9-8e7b-429e5a464387 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:37.852074 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-88b56979-88ce-45f9-8e7b-429e5a464387 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:37.852735 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-88b56979-88ce-45f9-8e7b-429e5a464387 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:37.853367 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-88b56979-88ce-45f9-8e7b-429e5a464387 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:37.854074 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-88b56979-88ce-45f9-8e7b-429e5a464387 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:37.854528 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-88b56979-88ce-45f9-8e7b-429e5a464387 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:37.855258 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-88b56979-88ce-45f9-8e7b-429e5a464387 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:37.888251 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-7df92c2b-7cf7-4176-afa8-a762ee5910c9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:37.906691 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-7df92c2b-7cf7-4176-afa8-a762ee5910c9 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1370 microversion: 2.1 time: 0.187685 Aug 24 03:32:37.909856 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 154/313] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:37 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1370 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:38.069513 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-88b56979-88ce-45f9-8e7b-429e5a464387 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:38.078653 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-88b56979-88ce-45f9-8e7b-429e5a464387 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1709 microversion: 2.1 time: 0.239900 Aug 24 03:32:38.079543 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 160/314] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:37 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1709 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:38.933152 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0d8e649c-6390-4deb-9a49-6be409db44a8 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:38.934762 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0d8e649c-6390-4deb-9a49-6be409db44a8 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:38.940913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=6 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:38.943992 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0d8e649c-6390-4deb-9a49-6be409db44a8 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:38.945917 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0d8e649c-6390-4deb-9a49-6be409db44a8 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:38.946468 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0d8e649c-6390-4deb-9a49-6be409db44a8 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:38.947119 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0d8e649c-6390-4deb-9a49-6be409db44a8 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:38.947954 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0d8e649c-6390-4deb-9a49-6be409db44a8 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:38.948543 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0d8e649c-6390-4deb-9a49-6be409db44a8 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:39.098711 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0d8e649c-6390-4deb-9a49-6be409db44a8 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:39.108845 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0d8e649c-6390-4deb-9a49-6be409db44a8 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1370 microversion: 2.1 time: 0.181102 Aug 24 03:32:39.109377 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-0e3d7a78-7434-437f-baac-e5cb8dd3565a tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:39.110568 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-0e3d7a78-7434-437f-baac-e5cb8dd3565a tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:39.113933 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 155/315] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:38 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1370 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:39.118428 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell0:SELECT=2 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:39.119254 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell0:SELECT=6 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:39.121388 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0e3d7a78-7434-437f-baac-e5cb8dd3565a tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:39.122077 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0e3d7a78-7434-437f-baac-e5cb8dd3565a tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:39.122837 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0e3d7a78-7434-437f-baac-e5cb8dd3565a tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:39.123789 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0e3d7a78-7434-437f-baac-e5cb8dd3565a tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:39.124460 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0e3d7a78-7434-437f-baac-e5cb8dd3565a tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:39.125149 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0e3d7a78-7434-437f-baac-e5cb8dd3565a tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:39.276837 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-0e3d7a78-7434-437f-baac-e5cb8dd3565a tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:39.287736 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-0e3d7a78-7434-437f-baac-e5cb8dd3565a tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1713 microversion: 2.1 time: 0.182593 Aug 24 03:32:39.288395 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 161/316] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:39 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1713 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:40.139041 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-beb95dda-e55c-426a-a1cf-5f693bfd12f0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:40.139651 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-beb95dda-e55c-426a-a1cf-5f693bfd12f0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:40.146723 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-beb95dda-e55c-426a-a1cf-5f693bfd12f0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:40.147200 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-beb95dda-e55c-426a-a1cf-5f693bfd12f0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:40.147629 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-beb95dda-e55c-426a-a1cf-5f693bfd12f0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:40.148315 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-beb95dda-e55c-426a-a1cf-5f693bfd12f0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:40.148782 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-beb95dda-e55c-426a-a1cf-5f693bfd12f0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:40.149205 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-beb95dda-e55c-426a-a1cf-5f693bfd12f0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:40.304367 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-beb95dda-e55c-426a-a1cf-5f693bfd12f0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:40.323742 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-beb95dda-e55c-426a-a1cf-5f693bfd12f0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1370 microversion: 2.1 time: 0.188142 Aug 24 03:32:40.329369 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 156/317] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:40 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1370 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:41.351214 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-1b524587-4307-4d2d-976f-fd0801dc06f6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:41.352551 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-1b524587-4307-4d2d-976f-fd0801dc06f6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:41.354533 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:41.361967 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1b524587-4307-4d2d-976f-fd0801dc06f6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:41.362469 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1b524587-4307-4d2d-976f-fd0801dc06f6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:41.363026 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1b524587-4307-4d2d-976f-fd0801dc06f6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:41.363736 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1b524587-4307-4d2d-976f-fd0801dc06f6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:41.364706 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1b524587-4307-4d2d-976f-fd0801dc06f6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:41.365193 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1b524587-4307-4d2d-976f-fd0801dc06f6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:41.382344 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell1:SELECT=100 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:41.514902 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-1b524587-4307-4d2d-976f-fd0801dc06f6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:41.527073 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-1b524587-4307-4d2d-976f-fd0801dc06f6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1370 microversion: 2.1 time: 0.179681 Aug 24 03:32:41.528036 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 162/318] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:41 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:42.547409 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ea234113-cf5e-448d-a4b6-77f4c7c9e18c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:42.548062 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ea234113-cf5e-448d-a4b6-77f4c7c9e18c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:42.557204 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ea234113-cf5e-448d-a4b6-77f4c7c9e18c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:42.561114 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ea234113-cf5e-448d-a4b6-77f4c7c9e18c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:42.561599 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ea234113-cf5e-448d-a4b6-77f4c7c9e18c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:42.562314 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ea234113-cf5e-448d-a4b6-77f4c7c9e18c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:42.562778 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ea234113-cf5e-448d-a4b6-77f4c7c9e18c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:42.563207 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ea234113-cf5e-448d-a4b6-77f4c7c9e18c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:42.801362 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ea234113-cf5e-448d-a4b6-77f4c7c9e18c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:42.811752 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ea234113-cf5e-448d-a4b6-77f4c7c9e18c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1370 microversion: 2.1 time: 0.267916 Aug 24 03:32:42.812852 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 157/319] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:42 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1370 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:43.189782 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-f919af5f-674b-431b-b06d-3b92b38941e2 req-8d80a7e0-4852-48c7-a537-b1941275e483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a6c958-f0bd-4b52-ab2c-15ff7e7b1280", "name": "network-vif-plugged", "status": "completed", "tag": "7def1576-8e43-41f3-b534-e7a7b46f1b54"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:43.201132 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-f919af5f-674b-431b-b06d-3b92b38941e2 req-8d80a7e0-4852-48c7-a537-b1941275e483 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:43.201923 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-f919af5f-674b-431b-b06d-3b92b38941e2 req-8d80a7e0-4852-48c7-a537-b1941275e483 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:43.202590 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-f919af5f-674b-431b-b06d-3b92b38941e2 req-8d80a7e0-4852-48c7-a537-b1941275e483 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:43.216663 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-f919af5f-674b-431b-b06d-3b92b38941e2 req-8d80a7e0-4852-48c7-a537-b1941275e483 service nova] Creating event network-vif-plugged:7def1576-8e43-41f3-b534-e7a7b46f1b54 for instance 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 on hv-cinder-85426 Aug 24 03:32:43.223578 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-f919af5f-674b-431b-b06d-3b92b38941e2 req-8d80a7e0-4852-48c7-a537-b1941275e483 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037536 Aug 24 03:32:43.225512 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 163/320] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:43.838171 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0c77ee43-485f-4874-86e3-3c2a3aeb0137 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:43.839694 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0c77ee43-485f-4874-86e3-3c2a3aeb0137 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:43.850544 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0c77ee43-485f-4874-86e3-3c2a3aeb0137 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:43.852015 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0c77ee43-485f-4874-86e3-3c2a3aeb0137 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:43.853777 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0c77ee43-485f-4874-86e3-3c2a3aeb0137 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:43.855733 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0c77ee43-485f-4874-86e3-3c2a3aeb0137 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:43.856619 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0c77ee43-485f-4874-86e3-3c2a3aeb0137 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:43.857293 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0c77ee43-485f-4874-86e3-3c2a3aeb0137 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:44.192240 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0c77ee43-485f-4874-86e3-3c2a3aeb0137 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:44.206037 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0c77ee43-485f-4874-86e3-3c2a3aeb0137 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1370 microversion: 2.1 time: 0.373234 Aug 24 03:32:44.206169 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 158/321] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:43 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1370 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:45.226831 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-97733ed8-64dd-4f32-86ec-5fbf02dd95f6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:45.227542 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-97733ed8-64dd-4f32-86ec-5fbf02dd95f6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:45.244406 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-97733ed8-64dd-4f32-86ec-5fbf02dd95f6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:45.245607 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-97733ed8-64dd-4f32-86ec-5fbf02dd95f6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:45.246226 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-97733ed8-64dd-4f32-86ec-5fbf02dd95f6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:45.247149 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-97733ed8-64dd-4f32-86ec-5fbf02dd95f6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:45.247750 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-97733ed8-64dd-4f32-86ec-5fbf02dd95f6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:45.248322 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-97733ed8-64dd-4f32-86ec-5fbf02dd95f6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:45.529391 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-97733ed8-64dd-4f32-86ec-5fbf02dd95f6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:45.553265 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-97733ed8-64dd-4f32-86ec-5fbf02dd95f6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1370 microversion: 2.1 time: 0.329702 Aug 24 03:32:45.554683 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 164/322] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:45 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1370 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:46.574819 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1e0373d9-19ba-48a0-a00e-078efa142951 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:46.576162 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1e0373d9-19ba-48a0-a00e-078efa142951 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:46.583507 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1e0373d9-19ba-48a0-a00e-078efa142951 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:46.584090 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1e0373d9-19ba-48a0-a00e-078efa142951 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:46.584596 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1e0373d9-19ba-48a0-a00e-078efa142951 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:46.585594 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1e0373d9-19ba-48a0-a00e-078efa142951 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:46.586120 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1e0373d9-19ba-48a0-a00e-078efa142951 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:46.586621 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1e0373d9-19ba-48a0-a00e-078efa142951 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:46.819586 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1e0373d9-19ba-48a0-a00e-078efa142951 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:46.832888 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1e0373d9-19ba-48a0-a00e-078efa142951 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1565 microversion: 2.1 time: 0.261770 Aug 24 03:32:46.834134 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 159/323] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:46 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1565 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:46.855538 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-ad0ed8d5-65b0-4ea6-8183-40464de7c474 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:46.856033 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-ad0ed8d5-65b0-4ea6-8183-40464de7c474 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:46.866088 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ad0ed8d5-65b0-4ea6-8183-40464de7c474 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:46.866706 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ad0ed8d5-65b0-4ea6-8183-40464de7c474 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:46.867220 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ad0ed8d5-65b0-4ea6-8183-40464de7c474 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:46.868116 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ad0ed8d5-65b0-4ea6-8183-40464de7c474 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:46.868512 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ad0ed8d5-65b0-4ea6-8183-40464de7c474 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:46.869893 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ad0ed8d5-65b0-4ea6-8183-40464de7c474 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:47.045692 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-ad0ed8d5-65b0-4ea6-8183-40464de7c474 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.194035 Aug 24 03:32:47.046339 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 165/324] 10.222.0.81 () {58 vars in 1275 bytes} [Wed Aug 24 03:32:46 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280/os-interface => generated 285 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:48.409653 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-ee120604-2bc2-4913-a090-c39c9044a9ef req-05c7b880-ff9e-4d18-9ade-80199048904f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76a6c958-f0bd-4b52-ab2c-15ff7e7b1280", "tag": "7def1576-8e43-41f3-b534-e7a7b46f1b54"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:48.426934 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-ee120604-2bc2-4913-a090-c39c9044a9ef req-05c7b880-ff9e-4d18-9ade-80199048904f service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:48.427909 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-ee120604-2bc2-4913-a090-c39c9044a9ef req-05c7b880-ff9e-4d18-9ade-80199048904f service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:48.428450 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-ee120604-2bc2-4913-a090-c39c9044a9ef req-05c7b880-ff9e-4d18-9ade-80199048904f service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:48.450458 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-ee120604-2bc2-4913-a090-c39c9044a9ef req-05c7b880-ff9e-4d18-9ade-80199048904f service nova] Creating event network-changed:7def1576-8e43-41f3-b534-e7a7b46f1b54 for instance 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 on hv-cinder-85426 Aug 24 03:32:48.458405 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-ee120604-2bc2-4913-a090-c39c9044a9ef req-05c7b880-ff9e-4d18-9ade-80199048904f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054548 Aug 24 03:32:48.459180 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 160/325] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:32:53.120864 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-9f33cdce-6f9f-4468-ab16-6e79eac7c91c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:53.121514 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-9f33cdce-6f9f-4468-ab16-6e79eac7c91c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:53.133221 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9f33cdce-6f9f-4468-ab16-6e79eac7c91c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:53.134119 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9f33cdce-6f9f-4468-ab16-6e79eac7c91c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:53.134352 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9f33cdce-6f9f-4468-ab16-6e79eac7c91c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:53.135166 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9f33cdce-6f9f-4468-ab16-6e79eac7c91c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:53.138076 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9f33cdce-6f9f-4468-ab16-6e79eac7c91c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:53.138657 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9f33cdce-6f9f-4468-ab16-6e79eac7c91c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:53.176550 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-9f33cdce-6f9f-4468-ab16-6e79eac7c91c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040/ips" status: 200 len: 152 microversion: 2.20 time: 0.058199 Aug 24 03:32:53.178211 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 166/326] 10.222.0.81 () {60 vars in 1289 bytes} [Wed Aug 24 03:32:53 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040/ips => generated 152 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:32:56.437975 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a375722a-299d-499c-ba72-0083c0f4fa2a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:56.438585 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a375722a-299d-499c-ba72-0083c0f4fa2a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:56.440527 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:56.445765 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a375722a-299d-499c-ba72-0083c0f4fa2a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:56.446260 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a375722a-299d-499c-ba72-0083c0f4fa2a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:56.446915 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a375722a-299d-499c-ba72-0083c0f4fa2a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:56.447612 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a375722a-299d-499c-ba72-0083c0f4fa2a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:56.448247 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a375722a-299d-499c-ba72-0083c0f4fa2a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:56.448678 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a375722a-299d-499c-ba72-0083c0f4fa2a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:56.479353 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.objects.instance [None req-a375722a-299d-499c-ba72-0083c0f4fa2a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lazy-loading 'flavor' on Instance uuid 4a89effc-2ad4-414e-bca5-d503b48fb040 {{(pid=120708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:32:56.715205 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a375722a-299d-499c-ba72-0083c0f4fa2a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "POST /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040/action" status: 202 len: 0 microversion: 2.20 time: 0.282247 Aug 24 03:32:56.716829 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 161/327] 10.222.0.81 () {62 vars in 1319 bytes} [Wed Aug 24 03:32:56 2022] POST /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:32:56.726064 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-98a82254-eae2-4be4-b631-ac455963efa5 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:56.727278 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-98a82254-eae2-4be4-b631-ac455963efa5 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:56.734721 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-98a82254-eae2-4be4-b631-ac455963efa5 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:56.735672 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-98a82254-eae2-4be4-b631-ac455963efa5 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:56.737081 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-98a82254-eae2-4be4-b631-ac455963efa5 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:56.738731 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-98a82254-eae2-4be4-b631-ac455963efa5 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:56.739251 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-98a82254-eae2-4be4-b631-ac455963efa5 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:56.739683 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-98a82254-eae2-4be4-b631-ac455963efa5 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:56.914493 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-98a82254-eae2-4be4-b631-ac455963efa5 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:56.927411 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-98a82254-eae2-4be4-b631-ac455963efa5 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:56.929768 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-98a82254-eae2-4be4-b631-ac455963efa5 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:56.936387 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-98a82254-eae2-4be4-b631-ac455963efa5 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1722 microversion: 2.20 time: 0.213915 Aug 24 03:32:56.938472 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 167/328] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:32:56 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:32:57.963002 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4745089a-150a-4310-ac31-5003fb26f605 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:57.964212 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-4745089a-150a-4310-ac31-5003fb26f605 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:57.972603 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4745089a-150a-4310-ac31-5003fb26f605 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:57.973289 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4745089a-150a-4310-ac31-5003fb26f605 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:57.973713 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4745089a-150a-4310-ac31-5003fb26f605 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:57.974554 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4745089a-150a-4310-ac31-5003fb26f605 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:57.975142 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4745089a-150a-4310-ac31-5003fb26f605 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:57.975786 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4745089a-150a-4310-ac31-5003fb26f605 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:58.006055 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:58.150440 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4745089a-150a-4310-ac31-5003fb26f605 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:58.160792 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4745089a-150a-4310-ac31-5003fb26f605 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:58.164015 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4745089a-150a-4310-ac31-5003fb26f605 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:58.166410 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4745089a-150a-4310-ac31-5003fb26f605 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1722 microversion: 2.20 time: 0.207899 Aug 24 03:32:58.168530 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 162/329] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:32:57 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:32:59.192648 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-81a328b9-c9e0-4885-b7dc-b7a95db0c2e1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:59.193316 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-81a328b9-c9e0-4885-b7dc-b7a95db0c2e1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:59.199885 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-81a328b9-c9e0-4885-b7dc-b7a95db0c2e1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:59.200652 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-81a328b9-c9e0-4885-b7dc-b7a95db0c2e1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:59.201124 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-81a328b9-c9e0-4885-b7dc-b7a95db0c2e1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:59.201831 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-81a328b9-c9e0-4885-b7dc-b7a95db0c2e1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:59.202448 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-81a328b9-c9e0-4885-b7dc-b7a95db0c2e1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:59.203150 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-81a328b9-c9e0-4885-b7dc-b7a95db0c2e1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:59.346998 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-81a328b9-c9e0-4885-b7dc-b7a95db0c2e1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:59.357014 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-81a328b9-c9e0-4885-b7dc-b7a95db0c2e1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:59.359048 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-81a328b9-c9e0-4885-b7dc-b7a95db0c2e1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:59.360431 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-81a328b9-c9e0-4885-b7dc-b7a95db0c2e1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1722 microversion: 2.20 time: 0.171880 Aug 24 03:32:59.361493 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 168/330] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:32:59 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:00.389773 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-6a8cc421-b946-4b07-a097-ce18b977240d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:00.390526 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-6a8cc421-b946-4b07-a097-ce18b977240d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:00.397790 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6a8cc421-b946-4b07-a097-ce18b977240d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:00.398560 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6a8cc421-b946-4b07-a097-ce18b977240d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:00.399043 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6a8cc421-b946-4b07-a097-ce18b977240d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:00.399842 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6a8cc421-b946-4b07-a097-ce18b977240d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:00.400399 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6a8cc421-b946-4b07-a097-ce18b977240d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:00.400955 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6a8cc421-b946-4b07-a097-ce18b977240d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:00.558340 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-6a8cc421-b946-4b07-a097-ce18b977240d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:00.571255 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-6a8cc421-b946-4b07-a097-ce18b977240d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:00.573238 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-6a8cc421-b946-4b07-a097-ce18b977240d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:00.574983 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-6a8cc421-b946-4b07-a097-ce18b977240d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1722 microversion: 2.20 time: 0.189592 Aug 24 03:33:00.576093 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 163/331] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:00 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:01.602160 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-a2eb8390-c5d0-4978-a04f-38264270c54c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:01.602901 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-a2eb8390-c5d0-4978-a04f-38264270c54c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:01.610657 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a2eb8390-c5d0-4978-a04f-38264270c54c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:01.611144 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a2eb8390-c5d0-4978-a04f-38264270c54c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:01.611827 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a2eb8390-c5d0-4978-a04f-38264270c54c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:01.612549 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a2eb8390-c5d0-4978-a04f-38264270c54c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:01.613028 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a2eb8390-c5d0-4978-a04f-38264270c54c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:01.613644 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a2eb8390-c5d0-4978-a04f-38264270c54c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:01.775793 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-a2eb8390-c5d0-4978-a04f-38264270c54c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:01.788734 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-a2eb8390-c5d0-4978-a04f-38264270c54c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:01.790574 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-a2eb8390-c5d0-4978-a04f-38264270c54c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:01.792209 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-a2eb8390-c5d0-4978-a04f-38264270c54c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1722 microversion: 2.20 time: 0.196318 Aug 24 03:33:01.792913 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 169/332] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:01 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:02.815806 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-211f3fe0-d176-4e06-b5e4-ab04c28c8103 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:02.817097 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-211f3fe0-d176-4e06-b5e4-ab04c28c8103 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:02.825090 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-211f3fe0-d176-4e06-b5e4-ab04c28c8103 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:02.825624 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-211f3fe0-d176-4e06-b5e4-ab04c28c8103 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:02.826251 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-211f3fe0-d176-4e06-b5e4-ab04c28c8103 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:02.827202 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-211f3fe0-d176-4e06-b5e4-ab04c28c8103 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:02.828181 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-211f3fe0-d176-4e06-b5e4-ab04c28c8103 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:02.828652 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-211f3fe0-d176-4e06-b5e4-ab04c28c8103 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:02.974871 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-211f3fe0-d176-4e06-b5e4-ab04c28c8103 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:02.984245 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-211f3fe0-d176-4e06-b5e4-ab04c28c8103 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:02.986272 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-211f3fe0-d176-4e06-b5e4-ab04c28c8103 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:02.991059 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-211f3fe0-d176-4e06-b5e4-ab04c28c8103 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1722 microversion: 2.20 time: 0.179109 Aug 24 03:33:02.991737 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 164/333] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:02 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:03.123159 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-2254af8f-89c5-4d4a-b487-808bd0c42b8d tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Action: 'create', calling method: .version_select at 0x7f942fd548b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-977926552", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL10NO3illZ66JEZaeca1Xa8rcBcQKRx7+4xwDHlLEhM5GGmNyouMEnJODO90D1vgFXtvpBD7EBgNP4VgCCuZSRIdY2tRN+OORx8HrgxZyrTB5ZDr2jJ1/AyDl0N7hfpMA=="}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:03.138489 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.quota [None req-2254af8f-89c5-4d4a-b487-808bd0c42b8d tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Getting quotas for project 60ed59a87fd44afb9064c8eef04b19c1. Resources: {'key_pairs'} {{(pid=120709) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:33:03.142312 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.quota [None req-2254af8f-89c5-4d4a-b487-808bd0c42b8d tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Getting quotas for user 37b485ad806647f595c5b359505f1dd0 and project 60ed59a87fd44afb9064c8eef04b19c1. Resources: {'key_pairs'} {{(pid=120709) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:33:03.164901 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-2254af8f-89c5-4d4a-b487-808bd0c42b8d tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.046420 Aug 24 03:33:03.165483 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 170/334] 10.222.0.81 () {60 vars in 1159 bytes} [Wed Aug 24 03:33:03 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:03.217862 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-9240331d-096a-4d9d-9084-4a562e215292 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-908410337", "imageRef": "b2fc4481-08a5-4034-9570-972245078580", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-977926552", "networks": [{"uuid": "51028d15-e390-412e-acdb-c26e7158d266"}]}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:03.270816 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.network.neutron [None req-9240331d-096a-4d9d-9084-4a562e215292 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] validate_networks() for [('51028d15-e390-412e-acdb-c26e7158d266', None, None, None, None, None)] {{(pid=120708) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:33:03.905275 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-9240331d-096a-4d9d-9084-4a562e215292 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Flavor limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:33:03.905839 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-9240331d-096a-4d9d-9084-4a562e215292 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Image limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:33:03.906230 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-9240331d-096a-4d9d-9084-4a562e215292 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Flavor pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:33:03.906647 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-9240331d-096a-4d9d-9084-4a562e215292 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Image pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:33:03.907091 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-9240331d-096a-4d9d-9084-4a562e215292 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:33:03.915894 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9240331d-096a-4d9d-9084-4a562e215292 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:03.916377 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9240331d-096a-4d9d-9084-4a562e215292 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:03.916845 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9240331d-096a-4d9d-9084-4a562e215292 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:03.919406 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9240331d-096a-4d9d-9084-4a562e215292 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:03.919880 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9240331d-096a-4d9d-9084-4a562e215292 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:03.920319 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9240331d-096a-4d9d-9084-4a562e215292 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:03.938452 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-9240331d-096a-4d9d-9084-4a562e215292 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Getting quotas for project 60ed59a87fd44afb9064c8eef04b19c1. Resources: {'ram', 'instances', 'cores'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:33:03.942387 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-9240331d-096a-4d9d-9084-4a562e215292 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Getting quotas for user 37b485ad806647f595c5b359505f1dd0 and project 60ed59a87fd44afb9064c8eef04b19c1. Resources: {'ram', 'instances', 'cores'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:33:03.954274 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-9240331d-096a-4d9d-9084-4a562e215292 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Going to run 1 instances... {{(pid=120708) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:33:03.956514 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-9240331d-096a-4d9d-9084-4a562e215292 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b2fc4481-08a5-4034-9570-972245078580',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120708) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:33:04.004799 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-9240331d-096a-4d9d-9084-4a562e215292 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.791064 Aug 24 03:33:04.005434 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 165/335] 10.222.0.81 () {60 vars in 1147 bytes} [Wed Aug 24 03:33:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:33:04.018272 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-4a71536c-6339-40a0-bbdc-1cbdf5dae8a0 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:04.019222 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d34f185e-3e07-4597-8cc3-d184f81c04ec tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:04.019773 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d34f185e-3e07-4597-8cc3-d184f81c04ec tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:04.019935 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-4a71536c-6339-40a0-bbdc-1cbdf5dae8a0 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:04.030448 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d34f185e-3e07-4597-8cc3-d184f81c04ec tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:04.031025 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d34f185e-3e07-4597-8cc3-d184f81c04ec tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:04.031529 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d34f185e-3e07-4597-8cc3-d184f81c04ec tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:04.032301 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d34f185e-3e07-4597-8cc3-d184f81c04ec tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:04.032850 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d34f185e-3e07-4597-8cc3-d184f81c04ec tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:04.033349 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d34f185e-3e07-4597-8cc3-d184f81c04ec tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:04.080998 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-4a71536c-6339-40a0-bbdc-1cbdf5dae8a0 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:04.095855 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-4a71536c-6339-40a0-bbdc-1cbdf5dae8a0 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1257 microversion: 2.1 time: 0.081391 Aug 24 03:33:04.096473 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 171/336] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:04 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1257 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:04.196656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d34f185e-3e07-4597-8cc3-d184f81c04ec tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:04.205800 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d34f185e-3e07-4597-8cc3-d184f81c04ec tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:04.207448 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d34f185e-3e07-4597-8cc3-d184f81c04ec tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:04.208630 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d34f185e-3e07-4597-8cc3-d184f81c04ec tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1722 microversion: 2.20 time: 0.193322 Aug 24 03:33:04.209232 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 166/337] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:04 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:05.117165 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-0da8aff0-2ac3-4650-8a70-7cf49e933be1 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:05.117789 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-0da8aff0-2ac3-4650-8a70-7cf49e933be1 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:05.125048 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0da8aff0-2ac3-4650-8a70-7cf49e933be1 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:05.125547 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0da8aff0-2ac3-4650-8a70-7cf49e933be1 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:05.125990 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0da8aff0-2ac3-4650-8a70-7cf49e933be1 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:05.126690 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0da8aff0-2ac3-4650-8a70-7cf49e933be1 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:05.127148 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0da8aff0-2ac3-4650-8a70-7cf49e933be1 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:05.127579 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0da8aff0-2ac3-4650-8a70-7cf49e933be1 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:05.191646 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-0da8aff0-2ac3-4650-8a70-7cf49e933be1 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:05.199677 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-0da8aff0-2ac3-4650-8a70-7cf49e933be1 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1309 microversion: 2.1 time: 0.086619 Aug 24 03:33:05.200673 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 172/338] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:05 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1309 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:05.232396 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-22cf071d-9673-4dca-9f76-71bfad5fb388 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:05.233694 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-22cf071d-9673-4dca-9f76-71bfad5fb388 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:05.240596 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-22cf071d-9673-4dca-9f76-71bfad5fb388 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:05.241121 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-22cf071d-9673-4dca-9f76-71bfad5fb388 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:05.241561 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-22cf071d-9673-4dca-9f76-71bfad5fb388 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:05.242267 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-22cf071d-9673-4dca-9f76-71bfad5fb388 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:05.242724 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-22cf071d-9673-4dca-9f76-71bfad5fb388 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:05.243153 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-22cf071d-9673-4dca-9f76-71bfad5fb388 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:05.389938 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-22cf071d-9673-4dca-9f76-71bfad5fb388 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:05.398865 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-22cf071d-9673-4dca-9f76-71bfad5fb388 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:05.400693 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-22cf071d-9673-4dca-9f76-71bfad5fb388 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:05.402710 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-22cf071d-9673-4dca-9f76-71bfad5fb388 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1722 microversion: 2.20 time: 0.175303 Aug 24 03:33:05.403349 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 167/339] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:05 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:06.228657 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-517448c7-3b69-4205-b1c5-d1e2ec34c7a4 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:06.230059 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-517448c7-3b69-4205-b1c5-d1e2ec34c7a4 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:06.246119 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-517448c7-3b69-4205-b1c5-d1e2ec34c7a4 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:06.247126 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-517448c7-3b69-4205-b1c5-d1e2ec34c7a4 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:06.248488 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-517448c7-3b69-4205-b1c5-d1e2ec34c7a4 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:06.249654 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-517448c7-3b69-4205-b1c5-d1e2ec34c7a4 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:06.250343 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-517448c7-3b69-4205-b1c5-d1e2ec34c7a4 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:06.250999 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-517448c7-3b69-4205-b1c5-d1e2ec34c7a4 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:06.428048 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-259a0cbd-be39-48c4-b0c5-2f47e0e927aa tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:06.429359 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-259a0cbd-be39-48c4-b0c5-2f47e0e927aa tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:06.438517 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-259a0cbd-be39-48c4-b0c5-2f47e0e927aa tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:06.439482 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-259a0cbd-be39-48c4-b0c5-2f47e0e927aa tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:06.440314 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-259a0cbd-be39-48c4-b0c5-2f47e0e927aa tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:06.441752 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-259a0cbd-be39-48c4-b0c5-2f47e0e927aa tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:06.442581 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-259a0cbd-be39-48c4-b0c5-2f47e0e927aa tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:06.443238 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-259a0cbd-be39-48c4-b0c5-2f47e0e927aa tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:06.483578 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-517448c7-3b69-4205-b1c5-d1e2ec34c7a4 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:06.495212 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-517448c7-3b69-4205-b1c5-d1e2ec34c7a4 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1357 microversion: 2.1 time: 0.273262 Aug 24 03:33:06.496027 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 173/340] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:06 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1357 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:06.591670 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-259a0cbd-be39-48c4-b0c5-2f47e0e927aa tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:06.599851 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-259a0cbd-be39-48c4-b0c5-2f47e0e927aa tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:06.601397 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-259a0cbd-be39-48c4-b0c5-2f47e0e927aa tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:06.602852 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-259a0cbd-be39-48c4-b0c5-2f47e0e927aa tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1722 microversion: 2.20 time: 0.178697 Aug 24 03:33:06.603641 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 168/341] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:06 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:07.519751 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-761cab69-d5ce-41e5-a389-dc3d65920cf5 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:07.521144 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-761cab69-d5ce-41e5-a389-dc3d65920cf5 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:07.530578 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-761cab69-d5ce-41e5-a389-dc3d65920cf5 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:07.531541 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-761cab69-d5ce-41e5-a389-dc3d65920cf5 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:07.532690 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-761cab69-d5ce-41e5-a389-dc3d65920cf5 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:07.534839 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-761cab69-d5ce-41e5-a389-dc3d65920cf5 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:07.534839 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-761cab69-d5ce-41e5-a389-dc3d65920cf5 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:07.534839 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-761cab69-d5ce-41e5-a389-dc3d65920cf5 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:07.627202 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a1f82d7e-b4c0-4649-9723-144707f63e72 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:07.627829 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a1f82d7e-b4c0-4649-9723-144707f63e72 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:07.634411 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a1f82d7e-b4c0-4649-9723-144707f63e72 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:07.634903 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a1f82d7e-b4c0-4649-9723-144707f63e72 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:07.635372 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a1f82d7e-b4c0-4649-9723-144707f63e72 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:07.636338 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a1f82d7e-b4c0-4649-9723-144707f63e72 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:07.636814 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a1f82d7e-b4c0-4649-9723-144707f63e72 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:07.637315 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a1f82d7e-b4c0-4649-9723-144707f63e72 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:07.704377 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-761cab69-d5ce-41e5-a389-dc3d65920cf5 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:07.720383 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-761cab69-d5ce-41e5-a389-dc3d65920cf5 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1357 microversion: 2.1 time: 0.205896 Aug 24 03:33:07.723283 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 174/342] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:07 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1357 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:07.818446 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a1f82d7e-b4c0-4649-9723-144707f63e72 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:07.827911 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a1f82d7e-b4c0-4649-9723-144707f63e72 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:07.829743 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a1f82d7e-b4c0-4649-9723-144707f63e72 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:07.830921 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a1f82d7e-b4c0-4649-9723-144707f63e72 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1722 microversion: 2.20 time: 0.208442 Aug 24 03:33:07.837329 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 169/343] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:07 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:33:08.742539 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-01387398-f28f-48da-b3c1-7c96ba1faa3b tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:08.744682 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-01387398-f28f-48da-b3c1-7c96ba1faa3b tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:08.751233 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-01387398-f28f-48da-b3c1-7c96ba1faa3b tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:08.752007 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-01387398-f28f-48da-b3c1-7c96ba1faa3b tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:08.752510 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-01387398-f28f-48da-b3c1-7c96ba1faa3b tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:08.753309 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-01387398-f28f-48da-b3c1-7c96ba1faa3b tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:08.753829 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-01387398-f28f-48da-b3c1-7c96ba1faa3b tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:08.754340 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-01387398-f28f-48da-b3c1-7c96ba1faa3b tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:08.855462 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a0b4357c-f1f4-4a8a-802d-dd868349bc53 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:08.856178 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a0b4357c-f1f4-4a8a-802d-dd868349bc53 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:08.862902 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a0b4357c-f1f4-4a8a-802d-dd868349bc53 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:08.863385 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a0b4357c-f1f4-4a8a-802d-dd868349bc53 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:08.863811 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a0b4357c-f1f4-4a8a-802d-dd868349bc53 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:08.864530 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a0b4357c-f1f4-4a8a-802d-dd868349bc53 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:08.865027 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a0b4357c-f1f4-4a8a-802d-dd868349bc53 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:08.865643 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a0b4357c-f1f4-4a8a-802d-dd868349bc53 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:08.895314 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-01387398-f28f-48da-b3c1-7c96ba1faa3b tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:08.906299 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-01387398-f28f-48da-b3c1-7c96ba1faa3b tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1357 microversion: 2.1 time: 0.167553 Aug 24 03:33:08.923340 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 175/344] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:08 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:09.072318 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a0b4357c-f1f4-4a8a-802d-dd868349bc53 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:09.080692 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a0b4357c-f1f4-4a8a-802d-dd868349bc53 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:09.082224 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a0b4357c-f1f4-4a8a-802d-dd868349bc53 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:09.083372 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a0b4357c-f1f4-4a8a-802d-dd868349bc53 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1722 microversion: 2.20 time: 0.232686 Aug 24 03:33:09.083922 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 170/345] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:08 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:33:09.930487 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-5a1df267-0aa2-418d-a7f8-62dec5366e4e tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:09.931108 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-5a1df267-0aa2-418d-a7f8-62dec5366e4e tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:09.937515 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5a1df267-0aa2-418d-a7f8-62dec5366e4e tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:09.938090 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5a1df267-0aa2-418d-a7f8-62dec5366e4e tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:09.938528 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5a1df267-0aa2-418d-a7f8-62dec5366e4e tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:09.939233 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5a1df267-0aa2-418d-a7f8-62dec5366e4e tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:09.939693 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5a1df267-0aa2-418d-a7f8-62dec5366e4e tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:09.940117 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5a1df267-0aa2-418d-a7f8-62dec5366e4e tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:10.099250 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-5a1df267-0aa2-418d-a7f8-62dec5366e4e tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:10.107870 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2aac63d6-afdc-4f9b-b160-6843769cf380 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:10.108605 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2aac63d6-afdc-4f9b-b160-6843769cf380 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:10.109201 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-5a1df267-0aa2-418d-a7f8-62dec5366e4e tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1357 microversion: 2.1 time: 0.182667 Aug 24 03:33:10.110041 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 176/346] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:09 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:10.118421 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2aac63d6-afdc-4f9b-b160-6843769cf380 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:10.122973 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2aac63d6-afdc-4f9b-b160-6843769cf380 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:10.123704 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2aac63d6-afdc-4f9b-b160-6843769cf380 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:10.124641 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2aac63d6-afdc-4f9b-b160-6843769cf380 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:10.125331 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2aac63d6-afdc-4f9b-b160-6843769cf380 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:10.125773 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2aac63d6-afdc-4f9b-b160-6843769cf380 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:10.288685 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2aac63d6-afdc-4f9b-b160-6843769cf380 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:10.302880 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2aac63d6-afdc-4f9b-b160-6843769cf380 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:10.305733 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2aac63d6-afdc-4f9b-b160-6843769cf380 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:10.308024 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2aac63d6-afdc-4f9b-b160-6843769cf380 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1722 microversion: 2.20 time: 0.205116 Aug 24 03:33:10.309812 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 171/347] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:10 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:11.132628 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-a333ab9c-90d4-421c-a415-e310dbe7ac8f tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:11.133428 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-a333ab9c-90d4-421c-a415-e310dbe7ac8f tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:11.139775 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a333ab9c-90d4-421c-a415-e310dbe7ac8f tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:11.140515 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a333ab9c-90d4-421c-a415-e310dbe7ac8f tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:11.140985 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a333ab9c-90d4-421c-a415-e310dbe7ac8f tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:11.141713 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a333ab9c-90d4-421c-a415-e310dbe7ac8f tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:11.142172 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a333ab9c-90d4-421c-a415-e310dbe7ac8f tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:11.142630 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a333ab9c-90d4-421c-a415-e310dbe7ac8f tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:11.278750 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-a333ab9c-90d4-421c-a415-e310dbe7ac8f tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:11.293780 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-a333ab9c-90d4-421c-a415-e310dbe7ac8f tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1357 microversion: 2.1 time: 0.164775 Aug 24 03:33:11.294867 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 177/348] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:11 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:11.331579 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-8b0b7d78-f220-4d08-a233-d7abd3af2075 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:11.333191 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-8b0b7d78-f220-4d08-a233-d7abd3af2075 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:11.340992 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8b0b7d78-f220-4d08-a233-d7abd3af2075 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:11.341555 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8b0b7d78-f220-4d08-a233-d7abd3af2075 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:11.342072 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8b0b7d78-f220-4d08-a233-d7abd3af2075 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:11.342874 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8b0b7d78-f220-4d08-a233-d7abd3af2075 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:11.343325 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8b0b7d78-f220-4d08-a233-d7abd3af2075 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:11.343771 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8b0b7d78-f220-4d08-a233-d7abd3af2075 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:11.498231 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-8b0b7d78-f220-4d08-a233-d7abd3af2075 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:11.516859 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-8b0b7d78-f220-4d08-a233-d7abd3af2075 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:11.518388 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-8b0b7d78-f220-4d08-a233-d7abd3af2075 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:11.519548 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-8b0b7d78-f220-4d08-a233-d7abd3af2075 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1722 microversion: 2.20 time: 0.191899 Aug 24 03:33:11.520466 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 172/349] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:11 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:12.317326 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-ce979797-f3c1-4845-9dc9-f96e52d16437 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:12.318972 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-ce979797-f3c1-4845-9dc9-f96e52d16437 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:12.321388 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:12.327878 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ce979797-f3c1-4845-9dc9-f96e52d16437 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:12.328432 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ce979797-f3c1-4845-9dc9-f96e52d16437 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:12.328924 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ce979797-f3c1-4845-9dc9-f96e52d16437 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:12.329659 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ce979797-f3c1-4845-9dc9-f96e52d16437 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:12.330116 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ce979797-f3c1-4845-9dc9-f96e52d16437 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:12.330549 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ce979797-f3c1-4845-9dc9-f96e52d16437 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:12.333744 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell1:SELECT=74 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:12.471742 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-ce979797-f3c1-4845-9dc9-f96e52d16437 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:12.480948 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-ce979797-f3c1-4845-9dc9-f96e52d16437 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1357 microversion: 2.1 time: 0.167473 Aug 24 03:33:12.481898 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 178/350] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:12 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:12.546582 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0360abc9-b450-4cf5-92f5-410c4a1d8c56 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:12.547191 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0360abc9-b450-4cf5-92f5-410c4a1d8c56 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:12.553628 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0360abc9-b450-4cf5-92f5-410c4a1d8c56 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:12.554108 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0360abc9-b450-4cf5-92f5-410c4a1d8c56 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:12.554545 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0360abc9-b450-4cf5-92f5-410c4a1d8c56 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:12.555223 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0360abc9-b450-4cf5-92f5-410c4a1d8c56 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:12.555668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0360abc9-b450-4cf5-92f5-410c4a1d8c56 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:12.556157 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0360abc9-b450-4cf5-92f5-410c4a1d8c56 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:12.702925 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0360abc9-b450-4cf5-92f5-410c4a1d8c56 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:12.712360 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0360abc9-b450-4cf5-92f5-410c4a1d8c56 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:12.714417 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0360abc9-b450-4cf5-92f5-410c4a1d8c56 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:12.716084 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0360abc9-b450-4cf5-92f5-410c4a1d8c56 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1722 microversion: 2.20 time: 0.173402 Aug 24 03:33:12.716976 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 173/351] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:12 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:13.508779 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-2041b9c2-25eb-4b60-9360-9c21f9800307 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:13.510924 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-2041b9c2-25eb-4b60-9360-9c21f9800307 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:13.517975 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2041b9c2-25eb-4b60-9360-9c21f9800307 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:13.518635 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2041b9c2-25eb-4b60-9360-9c21f9800307 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:13.519176 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2041b9c2-25eb-4b60-9360-9c21f9800307 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:13.520015 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2041b9c2-25eb-4b60-9360-9c21f9800307 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:13.520746 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2041b9c2-25eb-4b60-9360-9c21f9800307 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:13.521279 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2041b9c2-25eb-4b60-9360-9c21f9800307 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:13.703622 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-2041b9c2-25eb-4b60-9360-9c21f9800307 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:13.712251 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-2041b9c2-25eb-4b60-9360-9c21f9800307 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1357 microversion: 2.1 time: 0.208173 Aug 24 03:33:13.713028 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 179/352] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:13 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1357 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:13.740391 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-cde7b284-d3f6-473c-8415-2e48c0583eac tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:13.741061 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-cde7b284-d3f6-473c-8415-2e48c0583eac tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:13.748086 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cde7b284-d3f6-473c-8415-2e48c0583eac tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:13.748579 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cde7b284-d3f6-473c-8415-2e48c0583eac tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:13.749043 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cde7b284-d3f6-473c-8415-2e48c0583eac tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:13.749730 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cde7b284-d3f6-473c-8415-2e48c0583eac tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:13.750180 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cde7b284-d3f6-473c-8415-2e48c0583eac tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:13.750605 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cde7b284-d3f6-473c-8415-2e48c0583eac tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:13.888869 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-cde7b284-d3f6-473c-8415-2e48c0583eac tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:13.898308 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-cde7b284-d3f6-473c-8415-2e48c0583eac tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:13.899873 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-cde7b284-d3f6-473c-8415-2e48c0583eac tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:13.901075 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-cde7b284-d3f6-473c-8415-2e48c0583eac tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1722 microversion: 2.20 time: 0.165232 Aug 24 03:33:13.904682 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 174/353] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:13 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:14.734879 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-60b47c92-aa81-4724-8382-f2029a859b49 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:14.735891 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-60b47c92-aa81-4724-8382-f2029a859b49 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:14.737318 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell0:SELECT=6 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:14.742804 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-60b47c92-aa81-4724-8382-f2029a859b49 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:14.743288 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-60b47c92-aa81-4724-8382-f2029a859b49 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:14.743728 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-60b47c92-aa81-4724-8382-f2029a859b49 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:14.744425 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-60b47c92-aa81-4724-8382-f2029a859b49 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:14.744910 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-60b47c92-aa81-4724-8382-f2029a859b49 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:14.745342 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-60b47c92-aa81-4724-8382-f2029a859b49 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:14.875748 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-60b47c92-aa81-4724-8382-f2029a859b49 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:14.883244 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-60b47c92-aa81-4724-8382-f2029a859b49 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1357 microversion: 2.1 time: 0.152702 Aug 24 03:33:14.884146 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 180/354] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:14 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:14.925307 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-729c376d-44df-4455-a17f-24a2450c0520 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:14.925918 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-729c376d-44df-4455-a17f-24a2450c0520 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:14.927729 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=2 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:14.928388 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=6 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:14.935020 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-729c376d-44df-4455-a17f-24a2450c0520 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:14.935501 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-729c376d-44df-4455-a17f-24a2450c0520 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:14.935935 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-729c376d-44df-4455-a17f-24a2450c0520 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:14.936624 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-729c376d-44df-4455-a17f-24a2450c0520 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:14.937113 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-729c376d-44df-4455-a17f-24a2450c0520 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:14.937535 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-729c376d-44df-4455-a17f-24a2450c0520 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:15.070685 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-729c376d-44df-4455-a17f-24a2450c0520 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:15.078779 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-729c376d-44df-4455-a17f-24a2450c0520 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:15.080291 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-729c376d-44df-4455-a17f-24a2450c0520 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:15.081477 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-729c376d-44df-4455-a17f-24a2450c0520 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1722 microversion: 2.20 time: 0.160086 Aug 24 03:33:15.082031 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 175/355] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:14 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:15.904141 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-b88ec83c-09c6-4307-a74d-34b1ebc7487f tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:15.904781 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-b88ec83c-09c6-4307-a74d-34b1ebc7487f tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:15.912140 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b88ec83c-09c6-4307-a74d-34b1ebc7487f tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:15.912291 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b88ec83c-09c6-4307-a74d-34b1ebc7487f tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:15.912820 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b88ec83c-09c6-4307-a74d-34b1ebc7487f tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:15.913531 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b88ec83c-09c6-4307-a74d-34b1ebc7487f tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:15.913991 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b88ec83c-09c6-4307-a74d-34b1ebc7487f tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:15.914543 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b88ec83c-09c6-4307-a74d-34b1ebc7487f tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:16.044845 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-87302e10-85c5-4f12-9b20-dd484c516502 req-77a3d9e0-faad-42bc-a90c-42bd1124a2e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "733c5faa-7030-4ad2-9fe5-357ce22b115f", "tag": "925d9bc5-c59a-44c2-9c0d-39c5bc93381b"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:16.050306 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-b88ec83c-09c6-4307-a74d-34b1ebc7487f tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:16.060349 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-b88ec83c-09c6-4307-a74d-34b1ebc7487f tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1357 microversion: 2.1 time: 0.159790 Aug 24 03:33:16.062429 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 181/356] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:15 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:16.074741 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-87302e10-85c5-4f12-9b20-dd484c516502 req-77a3d9e0-faad-42bc-a90c-42bd1124a2e8 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:16.075970 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-87302e10-85c5-4f12-9b20-dd484c516502 req-77a3d9e0-faad-42bc-a90c-42bd1124a2e8 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:16.077020 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-87302e10-85c5-4f12-9b20-dd484c516502 req-77a3d9e0-faad-42bc-a90c-42bd1124a2e8 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:16.093445 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-87302e10-85c5-4f12-9b20-dd484c516502 req-77a3d9e0-faad-42bc-a90c-42bd1124a2e8 service nova] Creating event network-changed:925d9bc5-c59a-44c2-9c0d-39c5bc93381b for instance 733c5faa-7030-4ad2-9fe5-357ce22b115f on hv-cinder-85426 Aug 24 03:33:16.100687 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-87302e10-85c5-4f12-9b20-dd484c516502 req-77a3d9e0-faad-42bc-a90c-42bd1124a2e8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061023 Aug 24 03:33:16.101463 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 176/357] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:33:16.104868 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-225dc110-ce19-4e48-978e-c5482a196801 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:16.105649 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-225dc110-ce19-4e48-978e-c5482a196801 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:16.112202 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-225dc110-ce19-4e48-978e-c5482a196801 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:16.112683 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-225dc110-ce19-4e48-978e-c5482a196801 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:16.113147 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-225dc110-ce19-4e48-978e-c5482a196801 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:16.113834 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-225dc110-ce19-4e48-978e-c5482a196801 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:16.114280 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-225dc110-ce19-4e48-978e-c5482a196801 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:16.114700 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-225dc110-ce19-4e48-978e-c5482a196801 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:16.246398 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-225dc110-ce19-4e48-978e-c5482a196801 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:16.254399 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-225dc110-ce19-4e48-978e-c5482a196801 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:16.255893 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-225dc110-ce19-4e48-978e-c5482a196801 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:16.257062 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-225dc110-ce19-4e48-978e-c5482a196801 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1722 microversion: 2.20 time: 0.156414 Aug 24 03:33:16.257640 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 182/358] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:16 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:33:17.082697 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-31041f6e-5cf0-41c3-b1c0-582210454c36 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:17.083406 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-31041f6e-5cf0-41c3-b1c0-582210454c36 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:17.090911 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-31041f6e-5cf0-41c3-b1c0-582210454c36 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:17.091407 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-31041f6e-5cf0-41c3-b1c0-582210454c36 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:17.091873 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-31041f6e-5cf0-41c3-b1c0-582210454c36 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:17.092570 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-31041f6e-5cf0-41c3-b1c0-582210454c36 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:17.093052 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-31041f6e-5cf0-41c3-b1c0-582210454c36 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:17.093511 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-31041f6e-5cf0-41c3-b1c0-582210454c36 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:17.221734 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-31041f6e-5cf0-41c3-b1c0-582210454c36 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:17.230579 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-31041f6e-5cf0-41c3-b1c0-582210454c36 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1357 microversion: 2.1 time: 0.152276 Aug 24 03:33:17.231138 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 177/359] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:17 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:17.280888 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-1d6cdb44-bb33-4475-9972-ce0ec865d580 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:17.281505 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-1d6cdb44-bb33-4475-9972-ce0ec865d580 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:17.287613 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1d6cdb44-bb33-4475-9972-ce0ec865d580 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:17.288141 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1d6cdb44-bb33-4475-9972-ce0ec865d580 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:17.288583 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1d6cdb44-bb33-4475-9972-ce0ec865d580 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:17.289915 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1d6cdb44-bb33-4475-9972-ce0ec865d580 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:17.290368 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1d6cdb44-bb33-4475-9972-ce0ec865d580 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:17.290793 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1d6cdb44-bb33-4475-9972-ce0ec865d580 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:17.430823 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-1d6cdb44-bb33-4475-9972-ce0ec865d580 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:17.439109 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-1d6cdb44-bb33-4475-9972-ce0ec865d580 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:17.440739 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-1d6cdb44-bb33-4475-9972-ce0ec865d580 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:17.441915 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-1d6cdb44-bb33-4475-9972-ce0ec865d580 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1722 microversion: 2.20 time: 0.165053 Aug 24 03:33:17.442450 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 183/360] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:17 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:18.252146 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-9ccb585e-f39b-4ccc-b537-507200e24463 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:18.252999 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-9ccb585e-f39b-4ccc-b537-507200e24463 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:18.260703 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9ccb585e-f39b-4ccc-b537-507200e24463 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:18.261465 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9ccb585e-f39b-4ccc-b537-507200e24463 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:18.261900 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9ccb585e-f39b-4ccc-b537-507200e24463 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:18.262736 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9ccb585e-f39b-4ccc-b537-507200e24463 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:18.263156 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9ccb585e-f39b-4ccc-b537-507200e24463 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:18.263579 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9ccb585e-f39b-4ccc-b537-507200e24463 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:18.468529 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-8aba766a-2785-45d5-b4e9-db5ef8397ecf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:18.469221 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-8aba766a-2785-45d5-b4e9-db5ef8397ecf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:18.476944 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8aba766a-2785-45d5-b4e9-db5ef8397ecf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:18.477954 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8aba766a-2785-45d5-b4e9-db5ef8397ecf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:18.478390 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8aba766a-2785-45d5-b4e9-db5ef8397ecf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:18.479088 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8aba766a-2785-45d5-b4e9-db5ef8397ecf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:18.479539 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8aba766a-2785-45d5-b4e9-db5ef8397ecf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:18.479960 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8aba766a-2785-45d5-b4e9-db5ef8397ecf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:18.483583 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-9ccb585e-f39b-4ccc-b537-507200e24463 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:18.491465 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-9ccb585e-f39b-4ccc-b537-507200e24463 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1357 microversion: 2.1 time: 0.243215 Aug 24 03:33:18.492670 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 178/361] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:18 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1357 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:18.705536 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-8aba766a-2785-45d5-b4e9-db5ef8397ecf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:18.714176 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-8aba766a-2785-45d5-b4e9-db5ef8397ecf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:18.715696 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-8aba766a-2785-45d5-b4e9-db5ef8397ecf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:18.716907 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-8aba766a-2785-45d5-b4e9-db5ef8397ecf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1722 microversion: 2.20 time: 0.255008 Aug 24 03:33:18.717485 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 184/362] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:18 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:19.513124 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-29c6823c-0155-43c5-aa5c-5370da631e66 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:19.513753 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-29c6823c-0155-43c5-aa5c-5370da631e66 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:19.519840 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-29c6823c-0155-43c5-aa5c-5370da631e66 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:19.520317 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-29c6823c-0155-43c5-aa5c-5370da631e66 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:19.520751 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-29c6823c-0155-43c5-aa5c-5370da631e66 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:19.521451 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-29c6823c-0155-43c5-aa5c-5370da631e66 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:19.521897 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-29c6823c-0155-43c5-aa5c-5370da631e66 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:19.522354 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-29c6823c-0155-43c5-aa5c-5370da631e66 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:19.660068 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-29c6823c-0155-43c5-aa5c-5370da631e66 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:19.668005 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-29c6823c-0155-43c5-aa5c-5370da631e66 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1357 microversion: 2.1 time: 0.158963 Aug 24 03:33:19.668565 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 179/363] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:19 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:19.739432 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-5422303b-0fc2-4e81-a588-1afc3e6f8e43 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:19.740072 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-5422303b-0fc2-4e81-a588-1afc3e6f8e43 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:19.747164 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5422303b-0fc2-4e81-a588-1afc3e6f8e43 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:19.747648 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5422303b-0fc2-4e81-a588-1afc3e6f8e43 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:19.748084 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5422303b-0fc2-4e81-a588-1afc3e6f8e43 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:19.748858 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5422303b-0fc2-4e81-a588-1afc3e6f8e43 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:19.749391 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5422303b-0fc2-4e81-a588-1afc3e6f8e43 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:19.749819 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5422303b-0fc2-4e81-a588-1afc3e6f8e43 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:19.884874 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-5422303b-0fc2-4e81-a588-1afc3e6f8e43 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:19.893179 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-5422303b-0fc2-4e81-a588-1afc3e6f8e43 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:19.894699 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-5422303b-0fc2-4e81-a588-1afc3e6f8e43 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:19.895888 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-5422303b-0fc2-4e81-a588-1afc3e6f8e43 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1722 microversion: 2.20 time: 0.160361 Aug 24 03:33:19.896443 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 185/364] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:19 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:20.688570 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-40ebae3f-f978-4836-9f99-2139a4bf1286 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:20.689213 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-40ebae3f-f978-4836-9f99-2139a4bf1286 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:20.696094 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-40ebae3f-f978-4836-9f99-2139a4bf1286 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:20.696577 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-40ebae3f-f978-4836-9f99-2139a4bf1286 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:20.697049 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-40ebae3f-f978-4836-9f99-2139a4bf1286 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:20.697744 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-40ebae3f-f978-4836-9f99-2139a4bf1286 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:20.698195 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-40ebae3f-f978-4836-9f99-2139a4bf1286 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:20.698625 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-40ebae3f-f978-4836-9f99-2139a4bf1286 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:20.701287 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=100 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:20.830666 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-40ebae3f-f978-4836-9f99-2139a4bf1286 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:20.843005 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-40ebae3f-f978-4836-9f99-2139a4bf1286 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1357 microversion: 2.1 time: 0.157848 Aug 24 03:33:20.843656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 180/365] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:20 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:20.920869 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-545d9e7d-23a6-4472-b1f3-4b36e250d637 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:20.921480 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-545d9e7d-23a6-4472-b1f3-4b36e250d637 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:20.928706 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-545d9e7d-23a6-4472-b1f3-4b36e250d637 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:20.929758 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-545d9e7d-23a6-4472-b1f3-4b36e250d637 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:20.930216 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-545d9e7d-23a6-4472-b1f3-4b36e250d637 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:20.930909 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-545d9e7d-23a6-4472-b1f3-4b36e250d637 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:20.931358 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-545d9e7d-23a6-4472-b1f3-4b36e250d637 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:20.931779 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-545d9e7d-23a6-4472-b1f3-4b36e250d637 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:21.069084 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-545d9e7d-23a6-4472-b1f3-4b36e250d637 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:21.077536 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-545d9e7d-23a6-4472-b1f3-4b36e250d637 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:21.078985 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-545d9e7d-23a6-4472-b1f3-4b36e250d637 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:21.080137 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-545d9e7d-23a6-4472-b1f3-4b36e250d637 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1743 microversion: 2.20 time: 0.163648 Aug 24 03:33:21.080690 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 186/366] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:20 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1743 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:21.093744 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-3bd2c9ee-c2f8-41be-998d-f9df2dd9a3d2 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:21.094245 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-3bd2c9ee-c2f8-41be-998d-f9df2dd9a3d2 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:21.100520 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3bd2c9ee-c2f8-41be-998d-f9df2dd9a3d2 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:21.101780 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3bd2c9ee-c2f8-41be-998d-f9df2dd9a3d2 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:21.102384 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3bd2c9ee-c2f8-41be-998d-f9df2dd9a3d2 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:21.103081 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3bd2c9ee-c2f8-41be-998d-f9df2dd9a3d2 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:21.103533 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3bd2c9ee-c2f8-41be-998d-f9df2dd9a3d2 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:21.103958 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3bd2c9ee-c2f8-41be-998d-f9df2dd9a3d2 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:21.234131 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.objects.instance [None req-3bd2c9ee-c2f8-41be-998d-f9df2dd9a3d2 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lazy-loading 'services' on Instance uuid 9b97b3d6-5022-46c8-a189-fed177d028c8 {{(pid=120708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:33:21.386766 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-3bd2c9ee-c2f8-41be-998d-f9df2dd9a3d2 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "DELETE /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8/os-volume_attachments/7f3f6a73-11ac-4d0b-9ab8-1257e821fa11" status: 202 len: 0 microversion: 2.1 time: 0.295425 Aug 24 03:33:21.387189 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 181/367] 10.222.0.81 () {58 vars in 1416 bytes} [Wed Aug 24 03:33:21 2022] DELETE /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8/os-volume_attachments/7f3f6a73-11ac-4d0b-9ab8-1257e821fa11 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:33:21.865040 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-d69c1059-a463-4ec1-8c86-f24bb593a533 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:21.865654 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-d69c1059-a463-4ec1-8c86-f24bb593a533 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:21.871765 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d69c1059-a463-4ec1-8c86-f24bb593a533 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:21.872256 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d69c1059-a463-4ec1-8c86-f24bb593a533 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:21.872696 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d69c1059-a463-4ec1-8c86-f24bb593a533 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:21.873432 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d69c1059-a463-4ec1-8c86-f24bb593a533 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:21.874650 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d69c1059-a463-4ec1-8c86-f24bb593a533 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:21.875092 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d69c1059-a463-4ec1-8c86-f24bb593a533 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:22.004031 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-d69c1059-a463-4ec1-8c86-f24bb593a533 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:22.011708 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-d69c1059-a463-4ec1-8c86-f24bb593a533 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1357 microversion: 2.1 time: 0.150585 Aug 24 03:33:22.012257 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 187/368] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:21 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:22.104878 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a52a71a1-ca9d-410f-a6b2-2004c2759315 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:22.105576 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a52a71a1-ca9d-410f-a6b2-2004c2759315 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:22.112372 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a52a71a1-ca9d-410f-a6b2-2004c2759315 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:22.112883 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a52a71a1-ca9d-410f-a6b2-2004c2759315 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:22.113318 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a52a71a1-ca9d-410f-a6b2-2004c2759315 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:22.114012 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a52a71a1-ca9d-410f-a6b2-2004c2759315 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:22.114465 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a52a71a1-ca9d-410f-a6b2-2004c2759315 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:22.114887 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a52a71a1-ca9d-410f-a6b2-2004c2759315 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:22.251371 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a52a71a1-ca9d-410f-a6b2-2004c2759315 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:22.260238 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a52a71a1-ca9d-410f-a6b2-2004c2759315 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:22.261732 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a52a71a1-ca9d-410f-a6b2-2004c2759315 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:22.262953 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a52a71a1-ca9d-410f-a6b2-2004c2759315 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1743 microversion: 2.20 time: 0.163239 Aug 24 03:33:22.263507 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 182/369] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:22 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1743 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:22.527651 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-fa62dab9-9fbf-417d-9299-898689855d23 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:22.536326 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fa62dab9-9fbf-417d-9299-898689855d23 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:22.537192 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fa62dab9-9fbf-417d-9299-898689855d23 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:22.537842 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fa62dab9-9fbf-417d-9299-898689855d23 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:22.564801 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-fa62dab9-9fbf-417d-9299-898689855d23 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Going to try to stop instance {{(pid=120709) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 03:33:22.622475 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-fa62dab9-9fbf-417d-9299-898689855d23 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "POST /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8/action" status: 202 len: 0 microversion: 2.1 time: 0.098320 Aug 24 03:33:22.623075 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 188/370] 10.222.0.81 () {60 vars in 1278 bytes} [Wed Aug 24 03:33:22 2022] POST /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:33:22.631195 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-14d80daf-9147-44d9-a5c2-6fe5f22cb29c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:22.632571 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-14d80daf-9147-44d9-a5c2-6fe5f22cb29c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:22.638612 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-14d80daf-9147-44d9-a5c2-6fe5f22cb29c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:22.639148 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-14d80daf-9147-44d9-a5c2-6fe5f22cb29c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:22.639520 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-14d80daf-9147-44d9-a5c2-6fe5f22cb29c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:22.640373 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-14d80daf-9147-44d9-a5c2-6fe5f22cb29c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:22.640852 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-14d80daf-9147-44d9-a5c2-6fe5f22cb29c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:22.641267 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-14d80daf-9147-44d9-a5c2-6fe5f22cb29c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:22.793080 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-14d80daf-9147-44d9-a5c2-6fe5f22cb29c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:22.800816 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-14d80daf-9147-44d9-a5c2-6fe5f22cb29c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1677 microversion: 2.1 time: 0.173440 Aug 24 03:33:22.801377 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 183/371] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:22 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:33:23.032897 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-acd6310e-b846-482d-8bc2-25b10b700844 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:23.033639 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-acd6310e-b846-482d-8bc2-25b10b700844 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:23.040564 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-acd6310e-b846-482d-8bc2-25b10b700844 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:23.041157 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-acd6310e-b846-482d-8bc2-25b10b700844 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:23.041671 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-acd6310e-b846-482d-8bc2-25b10b700844 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:23.042442 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-acd6310e-b846-482d-8bc2-25b10b700844 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:23.042971 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-acd6310e-b846-482d-8bc2-25b10b700844 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:23.043631 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-acd6310e-b846-482d-8bc2-25b10b700844 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:23.211032 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-acd6310e-b846-482d-8bc2-25b10b700844 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:23.219700 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-acd6310e-b846-482d-8bc2-25b10b700844 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1357 microversion: 2.1 time: 0.190969 Aug 24 03:33:23.220854 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 189/372] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:23 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1357 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:23.290618 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-51ab32f1-464e-4170-832a-ac9532e8daa0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:23.291574 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-51ab32f1-464e-4170-832a-ac9532e8daa0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:23.298501 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-51ab32f1-464e-4170-832a-ac9532e8daa0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:23.299680 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-51ab32f1-464e-4170-832a-ac9532e8daa0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:23.300291 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-51ab32f1-464e-4170-832a-ac9532e8daa0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:23.301126 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-51ab32f1-464e-4170-832a-ac9532e8daa0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:23.301888 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-51ab32f1-464e-4170-832a-ac9532e8daa0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:23.302707 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-51ab32f1-464e-4170-832a-ac9532e8daa0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:23.461750 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-51ab32f1-464e-4170-832a-ac9532e8daa0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:23.474774 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-51ab32f1-464e-4170-832a-ac9532e8daa0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:23.476543 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-51ab32f1-464e-4170-832a-ac9532e8daa0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:23.477923 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-51ab32f1-464e-4170-832a-ac9532e8daa0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1743 microversion: 2.20 time: 0.194301 Aug 24 03:33:23.480960 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 184/373] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:23 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1743 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:23.504001 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-306cd2dd-a3b5-42a1-afd5-b1b590e28dde req-3392557e-9817-4b24-9dda-67e084f6a3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "733c5faa-7030-4ad2-9fe5-357ce22b115f", "name": "network-vif-plugged", "status": "completed", "tag": "925d9bc5-c59a-44c2-9c0d-39c5bc93381b"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:23.514564 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-306cd2dd-a3b5-42a1-afd5-b1b590e28dde req-3392557e-9817-4b24-9dda-67e084f6a3a4 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:23.515261 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-306cd2dd-a3b5-42a1-afd5-b1b590e28dde req-3392557e-9817-4b24-9dda-67e084f6a3a4 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:23.515940 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-306cd2dd-a3b5-42a1-afd5-b1b590e28dde req-3392557e-9817-4b24-9dda-67e084f6a3a4 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:23.529735 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-306cd2dd-a3b5-42a1-afd5-b1b590e28dde req-3392557e-9817-4b24-9dda-67e084f6a3a4 service nova] Creating event network-vif-plugged:925d9bc5-c59a-44c2-9c0d-39c5bc93381b for instance 733c5faa-7030-4ad2-9fe5-357ce22b115f on hv-cinder-85426 Aug 24 03:33:23.535142 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-306cd2dd-a3b5-42a1-afd5-b1b590e28dde req-3392557e-9817-4b24-9dda-67e084f6a3a4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035037 Aug 24 03:33:23.536314 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 190/374] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:23.824014 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-beb25b11-1221-4f82-97fd-7fcbbd5b6abd tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:23.824465 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-beb25b11-1221-4f82-97fd-7fcbbd5b6abd tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:23.830469 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-beb25b11-1221-4f82-97fd-7fcbbd5b6abd tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:23.830966 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-beb25b11-1221-4f82-97fd-7fcbbd5b6abd tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:23.831876 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-beb25b11-1221-4f82-97fd-7fcbbd5b6abd tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:23.832639 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-beb25b11-1221-4f82-97fd-7fcbbd5b6abd tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:23.833123 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-beb25b11-1221-4f82-97fd-7fcbbd5b6abd tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:23.833554 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-beb25b11-1221-4f82-97fd-7fcbbd5b6abd tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:23.978694 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-beb25b11-1221-4f82-97fd-7fcbbd5b6abd tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:23.987122 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-beb25b11-1221-4f82-97fd-7fcbbd5b6abd tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1677 microversion: 2.1 time: 0.168295 Aug 24 03:33:23.987688 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 185/375] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:23 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:24.242872 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-b849fe6e-d097-4579-9a6e-c30c1534da72 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:24.243917 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-b849fe6e-d097-4579-9a6e-c30c1534da72 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:24.249782 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b849fe6e-d097-4579-9a6e-c30c1534da72 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:24.250267 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b849fe6e-d097-4579-9a6e-c30c1534da72 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:24.250708 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b849fe6e-d097-4579-9a6e-c30c1534da72 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:24.251403 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b849fe6e-d097-4579-9a6e-c30c1534da72 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:24.251855 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b849fe6e-d097-4579-9a6e-c30c1534da72 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:24.252279 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b849fe6e-d097-4579-9a6e-c30c1534da72 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:24.390056 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-b849fe6e-d097-4579-9a6e-c30c1534da72 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:24.398730 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-b849fe6e-d097-4579-9a6e-c30c1534da72 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1357 microversion: 2.1 time: 0.161339 Aug 24 03:33:24.399310 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 191/376] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:24 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:24.501385 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-54706ca2-67b5-44b5-97f1-52365b68324c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:24.502578 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-54706ca2-67b5-44b5-97f1-52365b68324c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:24.510794 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-54706ca2-67b5-44b5-97f1-52365b68324c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:24.511543 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-54706ca2-67b5-44b5-97f1-52365b68324c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:24.512152 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-54706ca2-67b5-44b5-97f1-52365b68324c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:24.513050 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-54706ca2-67b5-44b5-97f1-52365b68324c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:24.513509 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-54706ca2-67b5-44b5-97f1-52365b68324c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:24.513937 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-54706ca2-67b5-44b5-97f1-52365b68324c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:24.654794 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-54706ca2-67b5-44b5-97f1-52365b68324c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:24.663760 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-54706ca2-67b5-44b5-97f1-52365b68324c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:24.665330 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-54706ca2-67b5-44b5-97f1-52365b68324c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:24.666656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-54706ca2-67b5-44b5-97f1-52365b68324c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1738 microversion: 2.20 time: 0.169571 Aug 24 03:33:24.676398 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 186/377] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:24 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:25.009251 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-1608c178-19c8-4579-9da1-45fbbd5ec130 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:25.010147 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-1608c178-19c8-4579-9da1-45fbbd5ec130 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:25.017785 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1608c178-19c8-4579-9da1-45fbbd5ec130 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:25.019648 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1608c178-19c8-4579-9da1-45fbbd5ec130 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:25.020089 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1608c178-19c8-4579-9da1-45fbbd5ec130 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:25.020803 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1608c178-19c8-4579-9da1-45fbbd5ec130 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:25.021255 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1608c178-19c8-4579-9da1-45fbbd5ec130 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:25.022428 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1608c178-19c8-4579-9da1-45fbbd5ec130 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:25.199842 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-1608c178-19c8-4579-9da1-45fbbd5ec130 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:25.208006 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-1608c178-19c8-4579-9da1-45fbbd5ec130 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1677 microversion: 2.1 time: 0.203126 Aug 24 03:33:25.222875 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 192/378] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:25 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1677 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:25.422409 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b07a16e5-2e2b-4800-a969-dc5c330e4534 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:25.423122 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-b07a16e5-2e2b-4800-a969-dc5c330e4534 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:25.435281 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b07a16e5-2e2b-4800-a969-dc5c330e4534 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:25.435771 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b07a16e5-2e2b-4800-a969-dc5c330e4534 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:25.436201 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b07a16e5-2e2b-4800-a969-dc5c330e4534 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:25.436936 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b07a16e5-2e2b-4800-a969-dc5c330e4534 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:25.437393 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b07a16e5-2e2b-4800-a969-dc5c330e4534 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:25.437828 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b07a16e5-2e2b-4800-a969-dc5c330e4534 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:25.556594 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-664a3fae-bafb-4fa5-8c08-66bde3e2a503 req-6f702572-0dae-465c-9e6b-f6859c293a7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a89effc-2ad4-414e-bca5-d503b48fb040", "name": "network-vif-plugged", "status": "completed", "tag": "57289a66-609a-46ea-b8c8-5258bbaf0864"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:25.571184 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-664a3fae-bafb-4fa5-8c08-66bde3e2a503 req-6f702572-0dae-465c-9e6b-f6859c293a7d service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:25.572358 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-664a3fae-bafb-4fa5-8c08-66bde3e2a503 req-6f702572-0dae-465c-9e6b-f6859c293a7d service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:25.573225 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-664a3fae-bafb-4fa5-8c08-66bde3e2a503 req-6f702572-0dae-465c-9e6b-f6859c293a7d service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:25.592177 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-664a3fae-bafb-4fa5-8c08-66bde3e2a503 req-6f702572-0dae-465c-9e6b-f6859c293a7d service nova] Creating event network-vif-plugged:57289a66-609a-46ea-b8c8-5258bbaf0864 for instance 4a89effc-2ad4-414e-bca5-d503b48fb040 on hv-cinder-85426 Aug 24 03:33:25.598649 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-664a3fae-bafb-4fa5-8c08-66bde3e2a503 req-6f702572-0dae-465c-9e6b-f6859c293a7d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046105 Aug 24 03:33:25.607450 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 193/379] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:33:25.632929 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-b07a16e5-2e2b-4800-a969-dc5c330e4534 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:25.642051 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-b07a16e5-2e2b-4800-a969-dc5c330e4534 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1357 microversion: 2.1 time: 0.226307 Aug 24 03:33:25.642645 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 187/380] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:25 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1357 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:25.708967 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-6fdd56b3-9889-417d-9c8b-ecfa33f792f7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:25.711090 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-6fdd56b3-9889-417d-9c8b-ecfa33f792f7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:25.718364 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6fdd56b3-9889-417d-9c8b-ecfa33f792f7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:25.719236 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6fdd56b3-9889-417d-9c8b-ecfa33f792f7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:25.719903 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6fdd56b3-9889-417d-9c8b-ecfa33f792f7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:25.720849 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6fdd56b3-9889-417d-9c8b-ecfa33f792f7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:25.721512 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6fdd56b3-9889-417d-9c8b-ecfa33f792f7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:25.722139 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6fdd56b3-9889-417d-9c8b-ecfa33f792f7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:25.865990 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-6fdd56b3-9889-417d-9c8b-ecfa33f792f7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:25.875409 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-6fdd56b3-9889-417d-9c8b-ecfa33f792f7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:25.877016 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-6fdd56b3-9889-417d-9c8b-ecfa33f792f7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:25.878214 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-6fdd56b3-9889-417d-9c8b-ecfa33f792f7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1738 microversion: 2.20 time: 0.186886 Aug 24 03:33:25.878767 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 194/381] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:25 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:26.233838 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-67476d76-364b-4dda-a235-94dc0a6fc16d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:26.234449 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-67476d76-364b-4dda-a235-94dc0a6fc16d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:26.241209 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-67476d76-364b-4dda-a235-94dc0a6fc16d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:26.241727 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-67476d76-364b-4dda-a235-94dc0a6fc16d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:26.242226 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-67476d76-364b-4dda-a235-94dc0a6fc16d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:26.242911 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-67476d76-364b-4dda-a235-94dc0a6fc16d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:26.243359 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-67476d76-364b-4dda-a235-94dc0a6fc16d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:26.243776 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-67476d76-364b-4dda-a235-94dc0a6fc16d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:26.401905 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-67476d76-364b-4dda-a235-94dc0a6fc16d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:26.409818 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-67476d76-364b-4dda-a235-94dc0a6fc16d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1677 microversion: 2.1 time: 0.184102 Aug 24 03:33:26.410385 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 188/382] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:26 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1677 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:26.663982 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-00525773-84b5-42fc-beeb-a80c9b913130 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:26.664711 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-00525773-84b5-42fc-beeb-a80c9b913130 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:26.670892 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-00525773-84b5-42fc-beeb-a80c9b913130 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:26.671384 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-00525773-84b5-42fc-beeb-a80c9b913130 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:26.672092 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-00525773-84b5-42fc-beeb-a80c9b913130 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:26.672896 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-00525773-84b5-42fc-beeb-a80c9b913130 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:26.673587 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-00525773-84b5-42fc-beeb-a80c9b913130 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:26.674026 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-00525773-84b5-42fc-beeb-a80c9b913130 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:26.676913 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:26.825143 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-00525773-84b5-42fc-beeb-a80c9b913130 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:26.839946 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-00525773-84b5-42fc-beeb-a80c9b913130 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1545 microversion: 2.1 time: 0.180356 Aug 24 03:33:26.840744 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 195/383] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:26 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1545 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:26.864192 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7b8c8920-9eca-44d6-aa7e-137d5618b62b tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:26.864833 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-7b8c8920-9eca-44d6-aa7e-137d5618b62b tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:26.868369 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:26.874191 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7b8c8920-9eca-44d6-aa7e-137d5618b62b tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:26.874995 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7b8c8920-9eca-44d6-aa7e-137d5618b62b tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:26.875441 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7b8c8920-9eca-44d6-aa7e-137d5618b62b tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:26.876330 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7b8c8920-9eca-44d6-aa7e-137d5618b62b tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:26.876813 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7b8c8920-9eca-44d6-aa7e-137d5618b62b tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:26.877421 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7b8c8920-9eca-44d6-aa7e-137d5618b62b tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:26.906643 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-d3b13784-cece-4193-944f-4a51523f9e50 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:26.907926 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-d3b13784-cece-4193-944f-4a51523f9e50 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:26.924403 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d3b13784-cece-4193-944f-4a51523f9e50 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:26.924927 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d3b13784-cece-4193-944f-4a51523f9e50 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:26.925442 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d3b13784-cece-4193-944f-4a51523f9e50 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:26.926293 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d3b13784-cece-4193-944f-4a51523f9e50 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:26.927036 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d3b13784-cece-4193-944f-4a51523f9e50 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:26.927545 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d3b13784-cece-4193-944f-4a51523f9e50 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:27.070066 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-7b8c8920-9eca-44d6-aa7e-137d5618b62b tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:27.084431 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-7b8c8920-9eca-44d6-aa7e-137d5618b62b tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1545 microversion: 2.1 time: 0.223590 Aug 24 03:33:27.085572 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 189/384] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:26 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1545 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:27.106191 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-57970a94-6ee7-481d-b823-45cc8c419c3d tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:27.113834 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-57970a94-6ee7-481d-b823-45cc8c419c3d tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:27.114622 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-57970a94-6ee7-481d-b823-45cc8c419c3d tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Searching by: {'deleted': False, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1'} {{(pid=120708) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:33:27.121902 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57970a94-6ee7-481d-b823-45cc8c419c3d tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:27.122457 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57970a94-6ee7-481d-b823-45cc8c419c3d tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:27.123322 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57970a94-6ee7-481d-b823-45cc8c419c3d tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:27.124383 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57970a94-6ee7-481d-b823-45cc8c419c3d tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:27.124866 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57970a94-6ee7-481d-b823-45cc8c419c3d tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:27.125298 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57970a94-6ee7-481d-b823-45cc8c419c3d tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:27.127287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-d3b13784-cece-4193-944f-4a51523f9e50 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:27.141405 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-d3b13784-cece-4193-944f-4a51523f9e50 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:27.143498 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-d3b13784-cece-4193-944f-4a51523f9e50 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:27.154069 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-d3b13784-cece-4193-944f-4a51523f9e50 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1738 microversion: 2.20 time: 0.251971 Aug 24 03:33:27.155326 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 196/385] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:26 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1738 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:33:27.241308 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.multi_cell_list [None req-57970a94-6ee7-481d-b823-45cc8c419c3d tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120708) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:33:27.343824 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-57970a94-6ee7-481d-b823-45cc8c419c3d tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.241798 Aug 24 03:33:27.344647 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 190/386] 10.222.0.81 () {58 vars in 1125 bytes} [Wed Aug 24 03:33:27 2022] GET /compute/v2.1/servers => generated 342 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:27.355707 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-1883c65d-5072-4d07-8712-cc661fd78fa9 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:27.356583 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-1883c65d-5072-4d07-8712-cc661fd78fa9 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:27.362692 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1883c65d-5072-4d07-8712-cc661fd78fa9 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:27.365566 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1883c65d-5072-4d07-8712-cc661fd78fa9 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:27.365566 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1883c65d-5072-4d07-8712-cc661fd78fa9 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:27.365566 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1883c65d-5072-4d07-8712-cc661fd78fa9 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:27.365566 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1883c65d-5072-4d07-8712-cc661fd78fa9 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:27.365938 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1883c65d-5072-4d07-8712-cc661fd78fa9 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:27.436542 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-6eee2749-9beb-4a23-8acc-d9fd6ba1ed34 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:27.437233 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-6eee2749-9beb-4a23-8acc-d9fd6ba1ed34 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:27.445266 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6eee2749-9beb-4a23-8acc-d9fd6ba1ed34 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:27.446126 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6eee2749-9beb-4a23-8acc-d9fd6ba1ed34 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:27.446781 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6eee2749-9beb-4a23-8acc-d9fd6ba1ed34 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:27.447712 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6eee2749-9beb-4a23-8acc-d9fd6ba1ed34 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:27.450959 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6eee2749-9beb-4a23-8acc-d9fd6ba1ed34 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:27.450959 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6eee2749-9beb-4a23-8acc-d9fd6ba1ed34 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:27.526146 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-1883c65d-5072-4d07-8712-cc661fd78fa9 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:27.535775 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-1883c65d-5072-4d07-8712-cc661fd78fa9 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1545 microversion: 2.1 time: 0.183792 Aug 24 03:33:27.549182 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 197/387] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:27 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1545 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:27.642420 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-6eee2749-9beb-4a23-8acc-d9fd6ba1ed34 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:27.651410 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-6eee2749-9beb-4a23-8acc-d9fd6ba1ed34 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1677 microversion: 2.1 time: 0.218862 Aug 24 03:33:27.653763 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 191/388] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:27 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1677 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:33:28.176988 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-21841acc-73ef-4011-9faf-e905cdabc64a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:28.178370 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-21841acc-73ef-4011-9faf-e905cdabc64a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:28.184608 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-21841acc-73ef-4011-9faf-e905cdabc64a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:28.185216 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-21841acc-73ef-4011-9faf-e905cdabc64a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:28.185745 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-21841acc-73ef-4011-9faf-e905cdabc64a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:28.186558 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-21841acc-73ef-4011-9faf-e905cdabc64a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:28.187118 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-21841acc-73ef-4011-9faf-e905cdabc64a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:28.187612 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-21841acc-73ef-4011-9faf-e905cdabc64a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:28.339297 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-21841acc-73ef-4011-9faf-e905cdabc64a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:28.349890 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-21841acc-73ef-4011-9faf-e905cdabc64a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:28.352022 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-21841acc-73ef-4011-9faf-e905cdabc64a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:28.353463 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-21841acc-73ef-4011-9faf-e905cdabc64a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1738 microversion: 2.20 time: 0.180592 Aug 24 03:33:28.369572 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 198/389] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:28 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1738 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:28.675411 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-104c0583-2487-4513-aabf-632c3d1233cb tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:28.676388 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-104c0583-2487-4513-aabf-632c3d1233cb tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:28.686541 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-104c0583-2487-4513-aabf-632c3d1233cb tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:28.687281 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-104c0583-2487-4513-aabf-632c3d1233cb tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:28.687912 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-104c0583-2487-4513-aabf-632c3d1233cb tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:28.688894 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-104c0583-2487-4513-aabf-632c3d1233cb tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:28.689398 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-104c0583-2487-4513-aabf-632c3d1233cb tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:28.689901 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-104c0583-2487-4513-aabf-632c3d1233cb tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:28.843147 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-104c0583-2487-4513-aabf-632c3d1233cb tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:28.851764 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-104c0583-2487-4513-aabf-632c3d1233cb tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1677 microversion: 2.1 time: 0.180135 Aug 24 03:33:28.852523 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 192/390] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:28 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:29.212964 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-7a352530-780a-470a-a146-61535fa4c48a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e941ff04-8f46-4fd1-bc02-0b6a7ffdafb3"}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:29.215816 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-7a352530-780a-470a-a146-61535fa4c48a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:29.222315 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7a352530-780a-470a-a146-61535fa4c48a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:29.222894 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7a352530-780a-470a-a146-61535fa4c48a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:29.223407 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7a352530-780a-470a-a146-61535fa4c48a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:29.225363 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7a352530-780a-470a-a146-61535fa4c48a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:29.226079 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7a352530-780a-470a-a146-61535fa4c48a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:29.226614 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7a352530-780a-470a-a146-61535fa4c48a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:29.381287 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c2613d3f-26c3-489f-9d95-eb4910496c3a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:29.382054 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c2613d3f-26c3-489f-9d95-eb4910496c3a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:29.390838 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c2613d3f-26c3-489f-9d95-eb4910496c3a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:29.391502 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c2613d3f-26c3-489f-9d95-eb4910496c3a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:29.391934 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c2613d3f-26c3-489f-9d95-eb4910496c3a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:29.392624 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c2613d3f-26c3-489f-9d95-eb4910496c3a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:29.393106 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c2613d3f-26c3-489f-9d95-eb4910496c3a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:29.393633 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c2613d3f-26c3-489f-9d95-eb4910496c3a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:29.564873 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c2613d3f-26c3-489f-9d95-eb4910496c3a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:29.574968 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c2613d3f-26c3-489f-9d95-eb4910496c3a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:29.576585 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c2613d3f-26c3-489f-9d95-eb4910496c3a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:29.577961 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c2613d3f-26c3-489f-9d95-eb4910496c3a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1738 microversion: 2.20 time: 0.201518 Aug 24 03:33:29.578693 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 193/391] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:29 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:33:29.595561 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-7a352530-780a-470a-a146-61535fa4c48a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "POST /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.387475 Aug 24 03:33:29.596335 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 199/392] 10.222.0.81 () {60 vars in 1323 bytes} [Wed Aug 24 03:33:29 2022] POST /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f/os-volume_attachments => generated 194 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:29.873456 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b7207fbc-86ab-4a12-a27e-738ed9a1c760 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:29.874296 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-b7207fbc-86ab-4a12-a27e-738ed9a1c760 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:29.880451 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b7207fbc-86ab-4a12-a27e-738ed9a1c760 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:29.880989 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b7207fbc-86ab-4a12-a27e-738ed9a1c760 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:29.881543 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b7207fbc-86ab-4a12-a27e-738ed9a1c760 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:29.882197 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b7207fbc-86ab-4a12-a27e-738ed9a1c760 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:29.882646 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b7207fbc-86ab-4a12-a27e-738ed9a1c760 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:29.883147 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b7207fbc-86ab-4a12-a27e-738ed9a1c760 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:30.037734 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-b7207fbc-86ab-4a12-a27e-738ed9a1c760 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:30.046261 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-b7207fbc-86ab-4a12-a27e-738ed9a1c760 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1677 microversion: 2.1 time: 0.176543 Aug 24 03:33:30.046815 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 194/393] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:29 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:30.602945 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-99f6fe6d-7a0a-4037-89f4-2b3fa5bf6c9a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:30.603546 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-99f6fe6d-7a0a-4037-89f4-2b3fa5bf6c9a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:30.610356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-99f6fe6d-7a0a-4037-89f4-2b3fa5bf6c9a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:30.611082 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-99f6fe6d-7a0a-4037-89f4-2b3fa5bf6c9a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:30.611746 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-99f6fe6d-7a0a-4037-89f4-2b3fa5bf6c9a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:30.612664 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-99f6fe6d-7a0a-4037-89f4-2b3fa5bf6c9a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:30.613413 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-99f6fe6d-7a0a-4037-89f4-2b3fa5bf6c9a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:30.614036 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-99f6fe6d-7a0a-4037-89f4-2b3fa5bf6c9a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:30.785979 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-99f6fe6d-7a0a-4037-89f4-2b3fa5bf6c9a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:30.794891 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-99f6fe6d-7a0a-4037-89f4-2b3fa5bf6c9a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:30.797104 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-99f6fe6d-7a0a-4037-89f4-2b3fa5bf6c9a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:30.798509 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-99f6fe6d-7a0a-4037-89f4-2b3fa5bf6c9a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1738 microversion: 2.20 time: 0.201084 Aug 24 03:33:30.799472 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 200/394] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:30 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1738 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:31.067690 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-283f8344-c28b-411c-89f3-242debcf1f7d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:31.068357 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-283f8344-c28b-411c-89f3-242debcf1f7d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:31.074407 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-283f8344-c28b-411c-89f3-242debcf1f7d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:31.075095 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-283f8344-c28b-411c-89f3-242debcf1f7d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:31.075712 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-283f8344-c28b-411c-89f3-242debcf1f7d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:31.076585 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-283f8344-c28b-411c-89f3-242debcf1f7d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:31.077225 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-283f8344-c28b-411c-89f3-242debcf1f7d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:31.078368 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-283f8344-c28b-411c-89f3-242debcf1f7d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:31.237092 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-283f8344-c28b-411c-89f3-242debcf1f7d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:31.239652 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:31.253640 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-283f8344-c28b-411c-89f3-242debcf1f7d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1677 microversion: 2.1 time: 0.189681 Aug 24 03:33:31.254867 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 195/395] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:31 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1677 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:31.822836 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-cf6b3295-c0b0-4623-b1bd-f96751dc42b6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:31.823683 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-cf6b3295-c0b0-4623-b1bd-f96751dc42b6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:31.836676 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cf6b3295-c0b0-4623-b1bd-f96751dc42b6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:31.836841 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cf6b3295-c0b0-4623-b1bd-f96751dc42b6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:31.837347 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cf6b3295-c0b0-4623-b1bd-f96751dc42b6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:31.838276 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cf6b3295-c0b0-4623-b1bd-f96751dc42b6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:31.838731 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cf6b3295-c0b0-4623-b1bd-f96751dc42b6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:31.839259 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cf6b3295-c0b0-4623-b1bd-f96751dc42b6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:32.005861 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-cf6b3295-c0b0-4623-b1bd-f96751dc42b6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:32.016629 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-cf6b3295-c0b0-4623-b1bd-f96751dc42b6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:32.018489 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-cf6b3295-c0b0-4623-b1bd-f96751dc42b6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:32.019767 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-cf6b3295-c0b0-4623-b1bd-f96751dc42b6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1738 microversion: 2.20 time: 0.201268 Aug 24 03:33:32.021163 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 201/396] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:31 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1738 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:32.278001 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-958e5a7c-3752-4263-ac56-7bf6fb101a9d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:32.280293 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-958e5a7c-3752-4263-ac56-7bf6fb101a9d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:32.288447 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-958e5a7c-3752-4263-ac56-7bf6fb101a9d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:32.289043 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-958e5a7c-3752-4263-ac56-7bf6fb101a9d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:32.289575 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-958e5a7c-3752-4263-ac56-7bf6fb101a9d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:32.290352 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-958e5a7c-3752-4263-ac56-7bf6fb101a9d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:32.290874 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-958e5a7c-3752-4263-ac56-7bf6fb101a9d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:32.291495 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-958e5a7c-3752-4263-ac56-7bf6fb101a9d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:32.455276 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-958e5a7c-3752-4263-ac56-7bf6fb101a9d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:32.480589 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-958e5a7c-3752-4263-ac56-7bf6fb101a9d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1677 microversion: 2.1 time: 0.207324 Aug 24 03:33:32.481903 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 196/397] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:32 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1677 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:33:33.046463 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-b07e9570-fea3-4cde-aad3-8bc2410d72e0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:33.048128 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-b07e9570-fea3-4cde-aad3-8bc2410d72e0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:33.056813 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b07e9570-fea3-4cde-aad3-8bc2410d72e0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:33.057890 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b07e9570-fea3-4cde-aad3-8bc2410d72e0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:33.058540 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b07e9570-fea3-4cde-aad3-8bc2410d72e0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:33.059487 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b07e9570-fea3-4cde-aad3-8bc2410d72e0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:33.060394 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b07e9570-fea3-4cde-aad3-8bc2410d72e0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:33.061805 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b07e9570-fea3-4cde-aad3-8bc2410d72e0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:33.206145 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-b07e9570-fea3-4cde-aad3-8bc2410d72e0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:33.215244 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-b07e9570-fea3-4cde-aad3-8bc2410d72e0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:33.217020 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-b07e9570-fea3-4cde-aad3-8bc2410d72e0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:33.217974 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-b07e9570-fea3-4cde-aad3-8bc2410d72e0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1738 microversion: 2.20 time: 0.175466 Aug 24 03:33:33.218534 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 202/398] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:33 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:33.504274 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-508c1a60-195a-4a32-9188-42b53b5d8b21 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:33.505619 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-508c1a60-195a-4a32-9188-42b53b5d8b21 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:33.511959 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-508c1a60-195a-4a32-9188-42b53b5d8b21 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:33.512435 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-508c1a60-195a-4a32-9188-42b53b5d8b21 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:33.512893 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-508c1a60-195a-4a32-9188-42b53b5d8b21 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:33.513579 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-508c1a60-195a-4a32-9188-42b53b5d8b21 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:33.514024 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-508c1a60-195a-4a32-9188-42b53b5d8b21 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:33.514441 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-508c1a60-195a-4a32-9188-42b53b5d8b21 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:33.645717 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-508c1a60-195a-4a32-9188-42b53b5d8b21 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:33.653613 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-508c1a60-195a-4a32-9188-42b53b5d8b21 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1654 microversion: 2.1 time: 0.153201 Aug 24 03:33:33.654182 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 197/399] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:33 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1654 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:33.673898 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-d00080d9-08da-40ef-bd26-454c2eb71874 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:33.680420 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d00080d9-08da-40ef-bd26-454c2eb71874 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:33.680930 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d00080d9-08da-40ef-bd26-454c2eb71874 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:33.681366 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d00080d9-08da-40ef-bd26-454c2eb71874 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:33.703387 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-d00080d9-08da-40ef-bd26-454c2eb71874 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Going to try to start instance {{(pid=120709) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 03:33:33.745279 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-d00080d9-08da-40ef-bd26-454c2eb71874 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "POST /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8/action" status: 202 len: 0 microversion: 2.1 time: 0.074959 Aug 24 03:33:33.745887 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 203/400] 10.222.0.81 () {60 vars in 1278 bytes} [Wed Aug 24 03:33:33 2022] POST /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:33:33.754010 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f5e901c9-f938-49a6-bd6e-2edffd676f51 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:33.754873 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f5e901c9-f938-49a6-bd6e-2edffd676f51 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:33.761452 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f5e901c9-f938-49a6-bd6e-2edffd676f51 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:33.762168 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f5e901c9-f938-49a6-bd6e-2edffd676f51 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:33.762777 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f5e901c9-f938-49a6-bd6e-2edffd676f51 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:33.763718 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f5e901c9-f938-49a6-bd6e-2edffd676f51 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:33.764327 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f5e901c9-f938-49a6-bd6e-2edffd676f51 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:33.764951 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f5e901c9-f938-49a6-bd6e-2edffd676f51 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:33.899704 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f5e901c9-f938-49a6-bd6e-2edffd676f51 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:33.908398 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f5e901c9-f938-49a6-bd6e-2edffd676f51 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1663 microversion: 2.1 time: 0.158213 Aug 24 03:33:33.909043 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 198/401] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:33 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1663 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:34.243785 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-62e9a5fb-acc1-41ec-9484-8af1827e8ac7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:34.244493 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-62e9a5fb-acc1-41ec-9484-8af1827e8ac7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:34.256453 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-62e9a5fb-acc1-41ec-9484-8af1827e8ac7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:34.257128 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-62e9a5fb-acc1-41ec-9484-8af1827e8ac7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:34.257829 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-62e9a5fb-acc1-41ec-9484-8af1827e8ac7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:34.258631 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-62e9a5fb-acc1-41ec-9484-8af1827e8ac7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:34.259161 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-62e9a5fb-acc1-41ec-9484-8af1827e8ac7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:34.259757 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-62e9a5fb-acc1-41ec-9484-8af1827e8ac7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:34.494590 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-62e9a5fb-acc1-41ec-9484-8af1827e8ac7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:34.503401 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-62e9a5fb-acc1-41ec-9484-8af1827e8ac7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:34.505657 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-62e9a5fb-acc1-41ec-9484-8af1827e8ac7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:34.506859 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-62e9a5fb-acc1-41ec-9484-8af1827e8ac7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1720 microversion: 2.20 time: 0.268519 Aug 24 03:33:34.507426 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 204/402] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:34 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1720 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:34.934671 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ae34ed4d-7217-43bb-b04f-ff29c828c15d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:34.935286 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ae34ed4d-7217-43bb-b04f-ff29c828c15d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:34.941696 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ae34ed4d-7217-43bb-b04f-ff29c828c15d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:34.942669 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ae34ed4d-7217-43bb-b04f-ff29c828c15d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:34.943098 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ae34ed4d-7217-43bb-b04f-ff29c828c15d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:34.943780 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ae34ed4d-7217-43bb-b04f-ff29c828c15d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:34.944224 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ae34ed4d-7217-43bb-b04f-ff29c828c15d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:34.944642 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ae34ed4d-7217-43bb-b04f-ff29c828c15d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:35.076510 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ae34ed4d-7217-43bb-b04f-ff29c828c15d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:35.084315 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ae34ed4d-7217-43bb-b04f-ff29c828c15d tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1663 microversion: 2.1 time: 0.153421 Aug 24 03:33:35.084900 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 199/403] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:34 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1663 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:35.095038 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-082d0436-49cb-4bd5-8993-601c2ced5c7b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55ea0a6f-9c4d-4d85-86ab-0b3492bd1cbc"}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:35.097609 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-082d0436-49cb-4bd5-8993-601c2ced5c7b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:35.103862 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-082d0436-49cb-4bd5-8993-601c2ced5c7b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:35.104351 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-082d0436-49cb-4bd5-8993-601c2ced5c7b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:35.105078 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-082d0436-49cb-4bd5-8993-601c2ced5c7b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:35.105797 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-082d0436-49cb-4bd5-8993-601c2ced5c7b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:35.106254 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-082d0436-49cb-4bd5-8993-601c2ced5c7b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:35.106901 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-082d0436-49cb-4bd5-8993-601c2ced5c7b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:35.530553 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-607f875c-a7e2-427a-8eee-53ff787dc9e9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:35.531149 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-607f875c-a7e2-427a-8eee-53ff787dc9e9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:35.537843 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-607f875c-a7e2-427a-8eee-53ff787dc9e9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:35.538312 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-607f875c-a7e2-427a-8eee-53ff787dc9e9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:35.538739 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-607f875c-a7e2-427a-8eee-53ff787dc9e9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:35.539417 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-607f875c-a7e2-427a-8eee-53ff787dc9e9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:35.539864 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-607f875c-a7e2-427a-8eee-53ff787dc9e9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:35.540281 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-607f875c-a7e2-427a-8eee-53ff787dc9e9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:35.672610 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-607f875c-a7e2-427a-8eee-53ff787dc9e9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:35.681441 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-607f875c-a7e2-427a-8eee-53ff787dc9e9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:35.682889 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-607f875c-a7e2-427a-8eee-53ff787dc9e9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:35.684024 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-607f875c-a7e2-427a-8eee-53ff787dc9e9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1720 microversion: 2.20 time: 0.157462 Aug 24 03:33:35.684592 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 200/404] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:35 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:33:36.105865 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-cfcffd93-5646-45f8-9c3e-607b4447969a tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:36.106463 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-cfcffd93-5646-45f8-9c3e-607b4447969a tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:36.112909 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cfcffd93-5646-45f8-9c3e-607b4447969a tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:36.113392 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cfcffd93-5646-45f8-9c3e-607b4447969a tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:36.113827 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cfcffd93-5646-45f8-9c3e-607b4447969a tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:36.115128 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cfcffd93-5646-45f8-9c3e-607b4447969a tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:36.115585 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cfcffd93-5646-45f8-9c3e-607b4447969a tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:36.116007 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cfcffd93-5646-45f8-9c3e-607b4447969a tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:36.242928 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-cfcffd93-5646-45f8-9c3e-607b4447969a tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:36.250787 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-cfcffd93-5646-45f8-9c3e-607b4447969a tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1663 microversion: 2.1 time: 0.148938 Aug 24 03:33:36.251353 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 201/405] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:36 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1663 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:33:36.706832 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2585eeb0-18fb-4c41-9455-489b10d1cc44 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:36.707359 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2585eeb0-18fb-4c41-9455-489b10d1cc44 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:36.713443 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2585eeb0-18fb-4c41-9455-489b10d1cc44 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:36.713931 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2585eeb0-18fb-4c41-9455-489b10d1cc44 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:36.714372 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2585eeb0-18fb-4c41-9455-489b10d1cc44 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:36.715060 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2585eeb0-18fb-4c41-9455-489b10d1cc44 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:36.715516 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2585eeb0-18fb-4c41-9455-489b10d1cc44 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:36.715941 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2585eeb0-18fb-4c41-9455-489b10d1cc44 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:36.842096 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2585eeb0-18fb-4c41-9455-489b10d1cc44 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:36.851362 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2585eeb0-18fb-4c41-9455-489b10d1cc44 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:36.852916 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2585eeb0-18fb-4c41-9455-489b10d1cc44 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:36.854126 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2585eeb0-18fb-4c41-9455-489b10d1cc44 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1720 microversion: 2.20 time: 0.151267 Aug 24 03:33:36.854935 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 202/406] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:36 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:33:37.138106 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-082d0436-49cb-4bd5-8993-601c2ced5c7b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "POST /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.046891 Aug 24 03:33:37.139008 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 205/407] 10.222.0.81 () {60 vars in 1323 bytes} [Wed Aug 24 03:33:35 2022] POST /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280/os-volume_attachments => generated 194 bytes in 2049 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:37.271476 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7ef7d38c-8a99-49ed-8d07-8f7d213f70f8 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:37.272225 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-7ef7d38c-8a99-49ed-8d07-8f7d213f70f8 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:37.274663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=2 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:37.280269 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7ef7d38c-8a99-49ed-8d07-8f7d213f70f8 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:37.280872 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7ef7d38c-8a99-49ed-8d07-8f7d213f70f8 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:37.281314 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7ef7d38c-8a99-49ed-8d07-8f7d213f70f8 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:37.282043 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7ef7d38c-8a99-49ed-8d07-8f7d213f70f8 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:37.282502 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7ef7d38c-8a99-49ed-8d07-8f7d213f70f8 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:37.282925 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7ef7d38c-8a99-49ed-8d07-8f7d213f70f8 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:37.342716 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-1a34e9cc-448b-4944-995f-cbdc57da600c req-d3778ef4-138c-4e2a-859f-cc54a795d7db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a89effc-2ad4-414e-bca5-d503b48fb040", "name": "network-vif-unplugged", "status": "completed", "tag": "57289a66-609a-46ea-b8c8-5258bbaf0864"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:37.356738 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-1a34e9cc-448b-4944-995f-cbdc57da600c req-d3778ef4-138c-4e2a-859f-cc54a795d7db service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:37.358254 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-1a34e9cc-448b-4944-995f-cbdc57da600c req-d3778ef4-138c-4e2a-859f-cc54a795d7db service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:37.358772 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-1a34e9cc-448b-4944-995f-cbdc57da600c req-d3778ef4-138c-4e2a-859f-cc54a795d7db service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:37.373082 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-1a34e9cc-448b-4944-995f-cbdc57da600c req-d3778ef4-138c-4e2a-859f-cc54a795d7db service nova] Creating event network-vif-unplugged:57289a66-609a-46ea-b8c8-5258bbaf0864 for instance 4a89effc-2ad4-414e-bca5-d503b48fb040 on hv-cinder-85426 Aug 24 03:33:37.377823 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-1a34e9cc-448b-4944-995f-cbdc57da600c req-d3778ef4-138c-4e2a-859f-cc54a795d7db service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039680 Aug 24 03:33:37.378410 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 206/408] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:37.434122 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-7ef7d38c-8a99-49ed-8d07-8f7d213f70f8 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:37.441895 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-7ef7d38c-8a99-49ed-8d07-8f7d213f70f8 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1667 microversion: 2.1 time: 0.174365 Aug 24 03:33:37.443709 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 203/409] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:37 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1667 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:37.878610 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-0fb0f835-bafb-4750-bd4a-3d700ef8b304 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:37.879308 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-0fb0f835-bafb-4750-bd4a-3d700ef8b304 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:37.886003 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0fb0f835-bafb-4750-bd4a-3d700ef8b304 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:37.886488 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0fb0f835-bafb-4750-bd4a-3d700ef8b304 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:37.886931 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0fb0f835-bafb-4750-bd4a-3d700ef8b304 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:37.887621 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0fb0f835-bafb-4750-bd4a-3d700ef8b304 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:37.888146 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0fb0f835-bafb-4750-bd4a-3d700ef8b304 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:37.888550 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0fb0f835-bafb-4750-bd4a-3d700ef8b304 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:38.033519 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-0fb0f835-bafb-4750-bd4a-3d700ef8b304 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:38.042518 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-0fb0f835-bafb-4750-bd4a-3d700ef8b304 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:38.045478 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-0fb0f835-bafb-4750-bd4a-3d700ef8b304 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:38.046657 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-0fb0f835-bafb-4750-bd4a-3d700ef8b304 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1723 microversion: 2.20 time: 0.172775 Aug 24 03:33:38.047373 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 207/410] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:37 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:38.070289 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d77b6a86-2dcc-4a2e-8be3-3f6b05c1d039 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b7dc90a-d27d-4673-8c6f-161c801916b4"}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:38.072829 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d77b6a86-2dcc-4a2e-8be3-3f6b05c1d039 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:38.078816 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d77b6a86-2dcc-4a2e-8be3-3f6b05c1d039 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:38.079399 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d77b6a86-2dcc-4a2e-8be3-3f6b05c1d039 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:38.079914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d77b6a86-2dcc-4a2e-8be3-3f6b05c1d039 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:38.080680 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d77b6a86-2dcc-4a2e-8be3-3f6b05c1d039 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:38.081266 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d77b6a86-2dcc-4a2e-8be3-3f6b05c1d039 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:38.081761 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d77b6a86-2dcc-4a2e-8be3-3f6b05c1d039 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:38.454937 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d77b6a86-2dcc-4a2e-8be3-3f6b05c1d039 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "POST /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.389414 Aug 24 03:33:38.455969 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 204/411] 10.222.0.81 () {62 vars in 1364 bytes} [Wed Aug 24 03:33:38 2022] POST /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040/os-volume_attachments => generated 188 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:33:38.500655 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-84e3e7df-0545-4384-82fe-085b1e9084a4 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:38.501939 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-84e3e7df-0545-4384-82fe-085b1e9084a4 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:38.508406 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-84e3e7df-0545-4384-82fe-085b1e9084a4 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:38.508931 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-84e3e7df-0545-4384-82fe-085b1e9084a4 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:38.509374 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-84e3e7df-0545-4384-82fe-085b1e9084a4 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:38.510069 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-84e3e7df-0545-4384-82fe-085b1e9084a4 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:38.510527 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-84e3e7df-0545-4384-82fe-085b1e9084a4 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:38.510948 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-84e3e7df-0545-4384-82fe-085b1e9084a4 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:38.618569 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2abac30a-8c08-4e35-b864-8593b7ba61e6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:38.619092 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2abac30a-8c08-4e35-b864-8593b7ba61e6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:38.626228 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2abac30a-8c08-4e35-b864-8593b7ba61e6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:38.626731 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2abac30a-8c08-4e35-b864-8593b7ba61e6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:38.627171 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2abac30a-8c08-4e35-b864-8593b7ba61e6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:38.627882 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2abac30a-8c08-4e35-b864-8593b7ba61e6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:38.628408 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2abac30a-8c08-4e35-b864-8593b7ba61e6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:38.628874 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2abac30a-8c08-4e35-b864-8593b7ba61e6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:38.867542 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2abac30a-8c08-4e35-b864-8593b7ba61e6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120708) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 03:33:38.889492 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-84e3e7df-0545-4384-82fe-085b1e9084a4 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:38.892081 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:38.901119 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-84e3e7df-0545-4384-82fe-085b1e9084a4 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1591 microversion: 2.1 time: 0.404258 Aug 24 03:33:38.901704 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 208/412] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:38 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1591 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:38.949691 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2abac30a-8c08-4e35-b864-8593b7ba61e6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "POST /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040/action" status: 202 len: 0 microversion: 2.20 time: 0.336305 Aug 24 03:33:38.953465 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 205/413] 10.222.0.81 () {62 vars in 1319 bytes} [Wed Aug 24 03:33:38 2022] POST /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:33:38.959845 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-2fb378a5-bdd1-4e76-9b5a-65451edc23dd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:38.960586 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-2fb378a5-bdd1-4e76-9b5a-65451edc23dd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:38.969585 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2fb378a5-bdd1-4e76-9b5a-65451edc23dd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:38.970159 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2fb378a5-bdd1-4e76-9b5a-65451edc23dd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:38.970674 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2fb378a5-bdd1-4e76-9b5a-65451edc23dd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:38.972219 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2fb378a5-bdd1-4e76-9b5a-65451edc23dd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:38.972757 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2fb378a5-bdd1-4e76-9b5a-65451edc23dd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:38.974340 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2fb378a5-bdd1-4e76-9b5a-65451edc23dd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:39.152157 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-2fb378a5-bdd1-4e76-9b5a-65451edc23dd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:39.162241 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-2fb378a5-bdd1-4e76-9b5a-65451edc23dd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:39.163875 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-2fb378a5-bdd1-4e76-9b5a-65451edc23dd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:39.165229 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-2fb378a5-bdd1-4e76-9b5a-65451edc23dd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1749 microversion: 2.20 time: 0.210172 Aug 24 03:33:39.165994 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 209/414] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:38 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1749 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:40.189766 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4fbe9b5c-e79a-49d5-a83e-40ca89f4c02d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:40.190524 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-4fbe9b5c-e79a-49d5-a83e-40ca89f4c02d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:40.197108 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4fbe9b5c-e79a-49d5-a83e-40ca89f4c02d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:40.197600 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4fbe9b5c-e79a-49d5-a83e-40ca89f4c02d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:40.198036 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4fbe9b5c-e79a-49d5-a83e-40ca89f4c02d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:40.198736 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4fbe9b5c-e79a-49d5-a83e-40ca89f4c02d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:40.199188 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4fbe9b5c-e79a-49d5-a83e-40ca89f4c02d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:40.199611 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4fbe9b5c-e79a-49d5-a83e-40ca89f4c02d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:40.334569 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4fbe9b5c-e79a-49d5-a83e-40ca89f4c02d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:40.343351 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4fbe9b5c-e79a-49d5-a83e-40ca89f4c02d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:40.344873 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4fbe9b5c-e79a-49d5-a83e-40ca89f4c02d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:40.346030 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4fbe9b5c-e79a-49d5-a83e-40ca89f4c02d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1751 microversion: 2.20 time: 0.160738 Aug 24 03:33:40.346582 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 206/415] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:40 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:40.772048 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-5517af76-ebde-4e0b-9fca-b27713d1b0eb req-fbee89a9-856a-44a5-b263-2e654d3395bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "733c5faa-7030-4ad2-9fe5-357ce22b115f", "tag": "925d9bc5-c59a-44c2-9c0d-39c5bc93381b"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:40.782329 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-5517af76-ebde-4e0b-9fca-b27713d1b0eb req-fbee89a9-856a-44a5-b263-2e654d3395bc service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:40.783104 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-5517af76-ebde-4e0b-9fca-b27713d1b0eb req-fbee89a9-856a-44a5-b263-2e654d3395bc service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:40.783626 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-5517af76-ebde-4e0b-9fca-b27713d1b0eb req-fbee89a9-856a-44a5-b263-2e654d3395bc service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:40.797843 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-5517af76-ebde-4e0b-9fca-b27713d1b0eb req-fbee89a9-856a-44a5-b263-2e654d3395bc service nova] Creating event network-changed:925d9bc5-c59a-44c2-9c0d-39c5bc93381b for instance 733c5faa-7030-4ad2-9fe5-357ce22b115f on hv-cinder-85426 Aug 24 03:33:40.803453 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-5517af76-ebde-4e0b-9fca-b27713d1b0eb req-fbee89a9-856a-44a5-b263-2e654d3395bc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036275 Aug 24 03:33:40.804451 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 210/416] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:33:41.371229 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-116aad46-f049-4e87-b62c-ead8d013719f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:41.371839 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-116aad46-f049-4e87-b62c-ead8d013719f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:41.383851 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-116aad46-f049-4e87-b62c-ead8d013719f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:41.385149 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-116aad46-f049-4e87-b62c-ead8d013719f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:41.386415 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-116aad46-f049-4e87-b62c-ead8d013719f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:41.387397 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-116aad46-f049-4e87-b62c-ead8d013719f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:41.388028 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-116aad46-f049-4e87-b62c-ead8d013719f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:41.389091 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-116aad46-f049-4e87-b62c-ead8d013719f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:41.623036 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-116aad46-f049-4e87-b62c-ead8d013719f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:41.632830 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-116aad46-f049-4e87-b62c-ead8d013719f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:41.634397 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-116aad46-f049-4e87-b62c-ead8d013719f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:41.635573 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-116aad46-f049-4e87-b62c-ead8d013719f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1751 microversion: 2.20 time: 0.268214 Aug 24 03:33:41.640331 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 207/417] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:41 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1751 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:41.864968 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-b41cba7a-cad5-4579-bb63-fc9abe79922a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-907969095"}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:41.865682 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-b41cba7a-cad5-4579-bb63-fc9abe79922a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:41.872656 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b41cba7a-cad5-4579-bb63-fc9abe79922a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:41.873111 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b41cba7a-cad5-4579-bb63-fc9abe79922a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:41.873554 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b41cba7a-cad5-4579-bb63-fc9abe79922a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:41.874262 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b41cba7a-cad5-4579-bb63-fc9abe79922a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:41.874712 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b41cba7a-cad5-4579-bb63-fc9abe79922a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:41.875134 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b41cba7a-cad5-4579-bb63-fc9abe79922a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:42.009608 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.network.security_group_api [None req-b41cba7a-cad5-4579-bb63-fc9abe79922a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Adding security group 6dacf5a4-4fd7-4bce-b670-764f73bca386 to port 925d9bc5-c59a-44c2-9c0d-39c5bc93381b Aug 24 03:33:42.332429 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-b41cba7a-cad5-4579-bb63-fc9abe79922a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "POST /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f/action" status: 202 len: 0 microversion: 2.1 time: 0.472124 Aug 24 03:33:42.333149 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 211/418] 10.222.0.81 () {60 vars in 1278 bytes} [Wed Aug 24 03:33:41 2022] POST /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:33:42.341918 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f37f2c7c-d6cb-4ce5-96a4-2d08fbadae04 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:42.342637 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f37f2c7c-d6cb-4ce5-96a4-2d08fbadae04 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:42.345447 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-57e48ae3-1a35-4dee-a04b-44424831f80c req-cffc98f8-0c2a-483f-bd59-f26de06d1f77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "733c5faa-7030-4ad2-9fe5-357ce22b115f", "tag": "925d9bc5-c59a-44c2-9c0d-39c5bc93381b"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:42.349659 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f37f2c7c-d6cb-4ce5-96a4-2d08fbadae04 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:42.350398 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f37f2c7c-d6cb-4ce5-96a4-2d08fbadae04 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:42.350849 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_api:SELECT=68 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:42.350986 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f37f2c7c-d6cb-4ce5-96a4-2d08fbadae04 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:42.351733 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f37f2c7c-d6cb-4ce5-96a4-2d08fbadae04 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:42.352251 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f37f2c7c-d6cb-4ce5-96a4-2d08fbadae04 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:42.353617 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f37f2c7c-d6cb-4ce5-96a4-2d08fbadae04 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:42.357318 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-57e48ae3-1a35-4dee-a04b-44424831f80c req-cffc98f8-0c2a-483f-bd59-f26de06d1f77 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:42.358503 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-57e48ae3-1a35-4dee-a04b-44424831f80c req-cffc98f8-0c2a-483f-bd59-f26de06d1f77 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:42.358980 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-57e48ae3-1a35-4dee-a04b-44424831f80c req-cffc98f8-0c2a-483f-bd59-f26de06d1f77 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:42.371634 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-57e48ae3-1a35-4dee-a04b-44424831f80c req-cffc98f8-0c2a-483f-bd59-f26de06d1f77 service nova] Creating event network-changed:925d9bc5-c59a-44c2-9c0d-39c5bc93381b for instance 733c5faa-7030-4ad2-9fe5-357ce22b115f on hv-cinder-85426 Aug 24 03:33:42.377076 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-57e48ae3-1a35-4dee-a04b-44424831f80c req-cffc98f8-0c2a-483f-bd59-f26de06d1f77 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035436 Aug 24 03:33:42.377991 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 212/419] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:33:42.536414 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f37f2c7c-d6cb-4ce5-96a4-2d08fbadae04 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:42.538720 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:42.547305 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f37f2c7c-d6cb-4ce5-96a4-2d08fbadae04 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1756 microversion: 2.1 time: 0.209206 Aug 24 03:33:42.548797 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 208/420] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:42 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1756 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:42.659713 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-ff03271d-24e5-4dd7-8591-aff7b7c7ff04 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:42.661360 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-ff03271d-24e5-4dd7-8591-aff7b7c7ff04 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:42.667541 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ff03271d-24e5-4dd7-8591-aff7b7c7ff04 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:42.668031 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ff03271d-24e5-4dd7-8591-aff7b7c7ff04 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:42.668470 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ff03271d-24e5-4dd7-8591-aff7b7c7ff04 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:42.669199 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ff03271d-24e5-4dd7-8591-aff7b7c7ff04 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:42.669650 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ff03271d-24e5-4dd7-8591-aff7b7c7ff04 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:42.670075 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ff03271d-24e5-4dd7-8591-aff7b7c7ff04 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:42.814647 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-ff03271d-24e5-4dd7-8591-aff7b7c7ff04 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:42.824615 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-ff03271d-24e5-4dd7-8591-aff7b7c7ff04 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:42.826564 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-ff03271d-24e5-4dd7-8591-aff7b7c7ff04 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:42.828010 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-ff03271d-24e5-4dd7-8591-aff7b7c7ff04 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1751 microversion: 2.20 time: 0.172672 Aug 24 03:33:42.828566 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 213/421] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:42 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:43.851867 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c8706975-5542-4d06-80d8-d732ba32d3df tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:43.852481 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c8706975-5542-4d06-80d8-d732ba32d3df tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:43.859927 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c8706975-5542-4d06-80d8-d732ba32d3df tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:43.860406 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c8706975-5542-4d06-80d8-d732ba32d3df tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:43.860866 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c8706975-5542-4d06-80d8-d732ba32d3df tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:43.861547 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c8706975-5542-4d06-80d8-d732ba32d3df tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:43.861991 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c8706975-5542-4d06-80d8-d732ba32d3df tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:43.862408 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c8706975-5542-4d06-80d8-d732ba32d3df tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:43.992846 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c8706975-5542-4d06-80d8-d732ba32d3df tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:44.001530 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c8706975-5542-4d06-80d8-d732ba32d3df tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:44.003051 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c8706975-5542-4d06-80d8-d732ba32d3df tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:44.004334 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c8706975-5542-4d06-80d8-d732ba32d3df tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1751 microversion: 2.20 time: 0.157515 Aug 24 03:33:44.004917 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 209/422] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:43 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:44.779259 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-66bb8b8e-a922-43a4-b037-f98ed426bfcf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:33:44.782131 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-66bb8b8e-a922-43a4-b037-f98ed426bfcf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:44.788757 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-66bb8b8e-a922-43a4-b037-f98ed426bfcf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:44.789281 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-66bb8b8e-a922-43a4-b037-f98ed426bfcf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:44.789755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-66bb8b8e-a922-43a4-b037-f98ed426bfcf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:44.790550 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-66bb8b8e-a922-43a4-b037-f98ed426bfcf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:44.791057 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-66bb8b8e-a922-43a4-b037-f98ed426bfcf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:44.791493 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-66bb8b8e-a922-43a4-b037-f98ed426bfcf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:44.816554 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.objects.instance [None req-66bb8b8e-a922-43a4-b037-f98ed426bfcf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lazy-loading 'flavor' on Instance uuid 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 {{(pid=120709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:33:44.936953 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-66bb8b8e-a922-43a4-b037-f98ed426bfcf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "POST /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280/action" status: 200 len: 32 microversion: 2.1 time: 0.161505 Aug 24 03:33:44.937555 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 214/423] 10.222.0.81 () {60 vars in 1278 bytes} [Wed Aug 24 03:33:44 2022] POST /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280/action => generated 32 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:33:44.947736 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f95a15fe-ec05-41e4-a122-c42a1dade79e tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:44.948512 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f95a15fe-ec05-41e4-a122-c42a1dade79e tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:44.954993 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f95a15fe-ec05-41e4-a122-c42a1dade79e tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:44.955480 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f95a15fe-ec05-41e4-a122-c42a1dade79e tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:44.955914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f95a15fe-ec05-41e4-a122-c42a1dade79e tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:44.957270 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f95a15fe-ec05-41e4-a122-c42a1dade79e tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:44.957728 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f95a15fe-ec05-41e4-a122-c42a1dade79e tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:44.958190 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f95a15fe-ec05-41e4-a122-c42a1dade79e tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:45.028356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-9db8a823-a79d-4c6f-b1bd-75b157aff5d9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:45.028985 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-9db8a823-a79d-4c6f-b1bd-75b157aff5d9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:45.035479 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9db8a823-a79d-4c6f-b1bd-75b157aff5d9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:45.035974 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9db8a823-a79d-4c6f-b1bd-75b157aff5d9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:45.036421 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9db8a823-a79d-4c6f-b1bd-75b157aff5d9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:45.037153 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9db8a823-a79d-4c6f-b1bd-75b157aff5d9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:45.037644 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9db8a823-a79d-4c6f-b1bd-75b157aff5d9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:45.038077 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9db8a823-a79d-4c6f-b1bd-75b157aff5d9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:45.131286 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f95a15fe-ec05-41e4-a122-c42a1dade79e tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:45.142567 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f95a15fe-ec05-41e4-a122-c42a1dade79e tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1735 microversion: 2.1 time: 0.198565 Aug 24 03:33:45.143375 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 210/424] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:44 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1735 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:45.200955 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-9db8a823-a79d-4c6f-b1bd-75b157aff5d9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:45.210142 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-9db8a823-a79d-4c6f-b1bd-75b157aff5d9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:45.211704 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-9db8a823-a79d-4c6f-b1bd-75b157aff5d9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:45.212862 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-9db8a823-a79d-4c6f-b1bd-75b157aff5d9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1751 microversion: 2.20 time: 0.188802 Aug 24 03:33:45.213413 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 215/425] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:45 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1751 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:33:46.165689 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-fee00a5d-a927-4b7c-aeb1-3fd87ed840a6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:46.166300 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-fee00a5d-a927-4b7c-aeb1-3fd87ed840a6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:46.172783 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fee00a5d-a927-4b7c-aeb1-3fd87ed840a6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:46.173285 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fee00a5d-a927-4b7c-aeb1-3fd87ed840a6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:46.173722 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fee00a5d-a927-4b7c-aeb1-3fd87ed840a6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:46.174413 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fee00a5d-a927-4b7c-aeb1-3fd87ed840a6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:46.175496 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fee00a5d-a927-4b7c-aeb1-3fd87ed840a6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:46.175986 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fee00a5d-a927-4b7c-aeb1-3fd87ed840a6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:46.235778 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-557b8c34-4b35-46df-b71d-73fa7b3ec5d3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:46.236377 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-557b8c34-4b35-46df-b71d-73fa7b3ec5d3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:46.243234 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-557b8c34-4b35-46df-b71d-73fa7b3ec5d3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:46.243723 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-557b8c34-4b35-46df-b71d-73fa7b3ec5d3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:46.244259 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-557b8c34-4b35-46df-b71d-73fa7b3ec5d3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:46.245071 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-557b8c34-4b35-46df-b71d-73fa7b3ec5d3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:46.245529 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-557b8c34-4b35-46df-b71d-73fa7b3ec5d3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:46.245956 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-557b8c34-4b35-46df-b71d-73fa7b3ec5d3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:46.356742 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-fee00a5d-a927-4b7c-aeb1-3fd87ed840a6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:46.366555 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-fee00a5d-a927-4b7c-aeb1-3fd87ed840a6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1735 microversion: 2.1 time: 0.204658 Aug 24 03:33:46.367249 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 211/426] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:46 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1735 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:46.406055 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-557b8c34-4b35-46df-b71d-73fa7b3ec5d3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:46.415479 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-557b8c34-4b35-46df-b71d-73fa7b3ec5d3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:46.417002 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-557b8c34-4b35-46df-b71d-73fa7b3ec5d3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:46.418250 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-557b8c34-4b35-46df-b71d-73fa7b3ec5d3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1807 microversion: 2.20 time: 0.186299 Aug 24 03:33:46.418886 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 216/427] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:46 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:33:47.388340 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4486bba2-9985-4c3f-9dc6-8ae18b357a93 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:47.389104 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-4486bba2-9985-4c3f-9dc6-8ae18b357a93 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:47.397738 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4486bba2-9985-4c3f-9dc6-8ae18b357a93 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:47.398554 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4486bba2-9985-4c3f-9dc6-8ae18b357a93 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:47.399250 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4486bba2-9985-4c3f-9dc6-8ae18b357a93 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:47.400174 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4486bba2-9985-4c3f-9dc6-8ae18b357a93 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:47.401635 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4486bba2-9985-4c3f-9dc6-8ae18b357a93 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:47.402426 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4486bba2-9985-4c3f-9dc6-8ae18b357a93 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:47.442655 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-46e05f71-0192-47a4-9709-0a67071f9dcf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:47.443623 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-46e05f71-0192-47a4-9709-0a67071f9dcf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:47.457900 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-46e05f71-0192-47a4-9709-0a67071f9dcf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:47.461041 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-46e05f71-0192-47a4-9709-0a67071f9dcf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:47.462740 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-46e05f71-0192-47a4-9709-0a67071f9dcf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:47.464572 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-46e05f71-0192-47a4-9709-0a67071f9dcf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:47.466350 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-46e05f71-0192-47a4-9709-0a67071f9dcf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:47.466811 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-46e05f71-0192-47a4-9709-0a67071f9dcf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:47.641990 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4486bba2-9985-4c3f-9dc6-8ae18b357a93 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:47.652568 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4486bba2-9985-4c3f-9dc6-8ae18b357a93 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1735 microversion: 2.1 time: 0.268670 Aug 24 03:33:47.653709 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 212/428] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:47 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1735 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:47.681153 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-46e05f71-0192-47a4-9709-0a67071f9dcf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:47.694579 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-46e05f71-0192-47a4-9709-0a67071f9dcf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:47.696432 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-46e05f71-0192-47a4-9709-0a67071f9dcf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:47.697861 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-46e05f71-0192-47a4-9709-0a67071f9dcf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1807 microversion: 2.20 time: 0.259793 Aug 24 03:33:47.698658 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 217/429] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:47 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1807 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:48.676524 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-9576a380-af73-4fac-85fd-fb0504a6631b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:48.677142 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-9576a380-af73-4fac-85fd-fb0504a6631b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:48.683514 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9576a380-af73-4fac-85fd-fb0504a6631b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:48.683996 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9576a380-af73-4fac-85fd-fb0504a6631b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:48.684424 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9576a380-af73-4fac-85fd-fb0504a6631b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:48.685138 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9576a380-af73-4fac-85fd-fb0504a6631b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:48.685583 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9576a380-af73-4fac-85fd-fb0504a6631b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:48.685999 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9576a380-af73-4fac-85fd-fb0504a6631b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:48.721724 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-17123231-99c5-4925-af7e-b144d40bf5eb tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:48.722648 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-17123231-99c5-4925-af7e-b144d40bf5eb tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:48.730684 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-17123231-99c5-4925-af7e-b144d40bf5eb tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:48.731270 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-17123231-99c5-4925-af7e-b144d40bf5eb tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:48.731934 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-17123231-99c5-4925-af7e-b144d40bf5eb tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:48.732925 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-17123231-99c5-4925-af7e-b144d40bf5eb tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:48.733580 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-17123231-99c5-4925-af7e-b144d40bf5eb tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:48.734216 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-17123231-99c5-4925-af7e-b144d40bf5eb tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:48.873134 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-9576a380-af73-4fac-85fd-fb0504a6631b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:48.881914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-9576a380-af73-4fac-85fd-fb0504a6631b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1735 microversion: 2.1 time: 0.209680 Aug 24 03:33:48.882633 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 213/430] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:48 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1735 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:48.921330 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-17123231-99c5-4925-af7e-b144d40bf5eb tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:48.932209 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-17123231-99c5-4925-af7e-b144d40bf5eb tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:48.933862 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-17123231-99c5-4925-af7e-b144d40bf5eb tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:48.935125 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-17123231-99c5-4925-af7e-b144d40bf5eb tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1807 microversion: 2.20 time: 0.217270 Aug 24 03:33:48.935778 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 218/431] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:48 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1807 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:33:49.918448 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-43e3713b-f7bd-4a5b-b9d3-fb9d36ce44d3 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:49.919079 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-43e3713b-f7bd-4a5b-b9d3-fb9d36ce44d3 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:49.926528 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-43e3713b-f7bd-4a5b-b9d3-fb9d36ce44d3 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:49.927188 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-43e3713b-f7bd-4a5b-b9d3-fb9d36ce44d3 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:49.927631 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-43e3713b-f7bd-4a5b-b9d3-fb9d36ce44d3 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:49.928336 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-43e3713b-f7bd-4a5b-b9d3-fb9d36ce44d3 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:49.928806 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-43e3713b-f7bd-4a5b-b9d3-fb9d36ce44d3 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:49.929231 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-43e3713b-f7bd-4a5b-b9d3-fb9d36ce44d3 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:49.961355 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-77dfbb9e-2990-452a-950a-eef0d62c2533 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:49.962487 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-77dfbb9e-2990-452a-950a-eef0d62c2533 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:49.980627 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-77dfbb9e-2990-452a-950a-eef0d62c2533 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:49.990147 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-77dfbb9e-2990-452a-950a-eef0d62c2533 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:49.990892 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-77dfbb9e-2990-452a-950a-eef0d62c2533 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:49.991870 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-77dfbb9e-2990-452a-950a-eef0d62c2533 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:49.992523 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-77dfbb9e-2990-452a-950a-eef0d62c2533 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:49.993116 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-77dfbb9e-2990-452a-950a-eef0d62c2533 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:50.155297 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-43e3713b-f7bd-4a5b-b9d3-fb9d36ce44d3 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:50.167717 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-43e3713b-f7bd-4a5b-b9d3-fb9d36ce44d3 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1735 microversion: 2.1 time: 0.266807 Aug 24 03:33:50.169424 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 214/432] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:49 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1735 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:50.219262 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-77dfbb9e-2990-452a-950a-eef0d62c2533 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:50.229870 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-77dfbb9e-2990-452a-950a-eef0d62c2533 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:50.231476 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-77dfbb9e-2990-452a-950a-eef0d62c2533 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:50.232597 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-77dfbb9e-2990-452a-950a-eef0d62c2533 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1807 microversion: 2.20 time: 0.278073 Aug 24 03:33:50.233184 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 219/433] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:49 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1807 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:51.191017 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-cda2291e-d676-4500-ae20-82fe5784b5b7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:51.192082 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-cda2291e-d676-4500-ae20-82fe5784b5b7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:51.202072 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cda2291e-d676-4500-ae20-82fe5784b5b7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:51.202557 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cda2291e-d676-4500-ae20-82fe5784b5b7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:51.202989 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cda2291e-d676-4500-ae20-82fe5784b5b7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:51.204541 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cda2291e-d676-4500-ae20-82fe5784b5b7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:51.205031 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cda2291e-d676-4500-ae20-82fe5784b5b7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:51.205459 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cda2291e-d676-4500-ae20-82fe5784b5b7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:51.263327 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-07a9c7fc-271c-4bd6-929d-339d389248c7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:51.263951 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-07a9c7fc-271c-4bd6-929d-339d389248c7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:51.272020 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-07a9c7fc-271c-4bd6-929d-339d389248c7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:51.272516 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-07a9c7fc-271c-4bd6-929d-339d389248c7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:51.272983 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-07a9c7fc-271c-4bd6-929d-339d389248c7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:51.273690 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-07a9c7fc-271c-4bd6-929d-339d389248c7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:51.274143 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-07a9c7fc-271c-4bd6-929d-339d389248c7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:51.274570 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-07a9c7fc-271c-4bd6-929d-339d389248c7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:51.414436 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-cda2291e-d676-4500-ae20-82fe5784b5b7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:51.423793 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-cda2291e-d676-4500-ae20-82fe5784b5b7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1735 microversion: 2.1 time: 0.237051 Aug 24 03:33:51.425502 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 215/434] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:51 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1735 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:51.489455 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-07a9c7fc-271c-4bd6-929d-339d389248c7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:51.498088 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-07a9c7fc-271c-4bd6-929d-339d389248c7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:51.499589 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-07a9c7fc-271c-4bd6-929d-339d389248c7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:51.500800 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-07a9c7fc-271c-4bd6-929d-339d389248c7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1807 microversion: 2.20 time: 0.241356 Aug 24 03:33:51.501361 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 220/435] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:51 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1807 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:33:52.459093 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2e6e2f95-07d3-4377-ad80-2e94b065566f tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:52.459694 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2e6e2f95-07d3-4377-ad80-2e94b065566f tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:52.466132 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2e6e2f95-07d3-4377-ad80-2e94b065566f tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:52.466619 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2e6e2f95-07d3-4377-ad80-2e94b065566f tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:52.467080 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2e6e2f95-07d3-4377-ad80-2e94b065566f tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:52.467774 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2e6e2f95-07d3-4377-ad80-2e94b065566f tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:52.468232 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2e6e2f95-07d3-4377-ad80-2e94b065566f tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:52.468656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2e6e2f95-07d3-4377-ad80-2e94b065566f tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:52.529955 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-a6f4e2ff-bdc3-4376-9ff5-6cc595a6d903 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:52.539948 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-a6f4e2ff-bdc3-4376-9ff5-6cc595a6d903 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:52.550612 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a6f4e2ff-bdc3-4376-9ff5-6cc595a6d903 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:52.552947 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a6f4e2ff-bdc3-4376-9ff5-6cc595a6d903 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:52.553642 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a6f4e2ff-bdc3-4376-9ff5-6cc595a6d903 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:52.554585 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a6f4e2ff-bdc3-4376-9ff5-6cc595a6d903 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:52.555261 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a6f4e2ff-bdc3-4376-9ff5-6cc595a6d903 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:52.555913 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a6f4e2ff-bdc3-4376-9ff5-6cc595a6d903 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:52.669303 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2e6e2f95-07d3-4377-ad80-2e94b065566f tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:52.678982 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2e6e2f95-07d3-4377-ad80-2e94b065566f tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1735 microversion: 2.1 time: 0.223858 Aug 24 03:33:52.679572 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 216/436] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:52 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1735 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:52.736528 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-a6f4e2ff-bdc3-4376-9ff5-6cc595a6d903 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:52.746369 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-a6f4e2ff-bdc3-4376-9ff5-6cc595a6d903 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:52.747975 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-a6f4e2ff-bdc3-4376-9ff5-6cc595a6d903 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:52.749294 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-a6f4e2ff-bdc3-4376-9ff5-6cc595a6d903 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1807 microversion: 2.20 time: 0.228949 Aug 24 03:33:52.749927 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 221/437] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:52 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1807 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:53.701438 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-dad73ef2-30d1-4a5a-a687-4045bcd7fb66 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:53.702106 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-dad73ef2-30d1-4a5a-a687-4045bcd7fb66 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:53.708987 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dad73ef2-30d1-4a5a-a687-4045bcd7fb66 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:53.709645 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dad73ef2-30d1-4a5a-a687-4045bcd7fb66 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:53.710141 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dad73ef2-30d1-4a5a-a687-4045bcd7fb66 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:53.710917 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dad73ef2-30d1-4a5a-a687-4045bcd7fb66 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:53.711413 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dad73ef2-30d1-4a5a-a687-4045bcd7fb66 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:53.712008 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-dad73ef2-30d1-4a5a-a687-4045bcd7fb66 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:53.772950 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-05bc95e1-4f1c-4d58-b4e7-5ec5967bc29d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:53.774228 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-05bc95e1-4f1c-4d58-b4e7-5ec5967bc29d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:53.780998 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-05bc95e1-4f1c-4d58-b4e7-5ec5967bc29d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:53.781695 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-05bc95e1-4f1c-4d58-b4e7-5ec5967bc29d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:53.782418 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-05bc95e1-4f1c-4d58-b4e7-5ec5967bc29d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:53.783306 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-05bc95e1-4f1c-4d58-b4e7-5ec5967bc29d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:53.784104 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-05bc95e1-4f1c-4d58-b4e7-5ec5967bc29d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:53.784736 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-05bc95e1-4f1c-4d58-b4e7-5ec5967bc29d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:53.951154 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-dad73ef2-30d1-4a5a-a687-4045bcd7fb66 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:53.960175 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-dad73ef2-30d1-4a5a-a687-4045bcd7fb66 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1735 microversion: 2.1 time: 0.262614 Aug 24 03:33:53.960858 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 217/438] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:53 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1735 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:53.979536 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-05bc95e1-4f1c-4d58-b4e7-5ec5967bc29d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:53.991001 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-05bc95e1-4f1c-4d58-b4e7-5ec5967bc29d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:53.992515 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-05bc95e1-4f1c-4d58-b4e7-5ec5967bc29d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:53.993749 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-05bc95e1-4f1c-4d58-b4e7-5ec5967bc29d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1807 microversion: 2.20 time: 0.224883 Aug 24 03:33:53.994304 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 222/439] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:53 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1807 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:33:54.987610 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-107273ac-21bd-4aff-a06f-c6468cdee21b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:54.988665 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-107273ac-21bd-4aff-a06f-c6468cdee21b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:55.010544 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-107273ac-21bd-4aff-a06f-c6468cdee21b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:55.011040 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-107273ac-21bd-4aff-a06f-c6468cdee21b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:55.011481 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-107273ac-21bd-4aff-a06f-c6468cdee21b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:55.012223 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-107273ac-21bd-4aff-a06f-c6468cdee21b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:55.012930 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-107273ac-21bd-4aff-a06f-c6468cdee21b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:55.013361 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-107273ac-21bd-4aff-a06f-c6468cdee21b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:55.017400 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-cd5c799c-9e30-4ccf-8a73-f05dff79523a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:55.018253 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-cd5c799c-9e30-4ccf-8a73-f05dff79523a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:55.025017 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cd5c799c-9e30-4ccf-8a73-f05dff79523a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:55.025556 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cd5c799c-9e30-4ccf-8a73-f05dff79523a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:55.025958 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cd5c799c-9e30-4ccf-8a73-f05dff79523a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:55.026644 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cd5c799c-9e30-4ccf-8a73-f05dff79523a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:55.027095 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cd5c799c-9e30-4ccf-8a73-f05dff79523a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:55.027522 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cd5c799c-9e30-4ccf-8a73-f05dff79523a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:55.238409 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-107273ac-21bd-4aff-a06f-c6468cdee21b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:55.241833 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-cd5c799c-9e30-4ccf-8a73-f05dff79523a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:55.247711 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-107273ac-21bd-4aff-a06f-c6468cdee21b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1735 microversion: 2.1 time: 0.267462 Aug 24 03:33:55.248609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 218/440] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:54 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1735 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:55.250472 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-cd5c799c-9e30-4ccf-8a73-f05dff79523a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:55.251968 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-cd5c799c-9e30-4ccf-8a73-f05dff79523a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:55.253288 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-cd5c799c-9e30-4ccf-8a73-f05dff79523a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1807 microversion: 2.20 time: 0.239733 Aug 24 03:33:55.253829 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 223/441] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:55 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1807 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:33:56.282475 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4a3b9903-47a3-456c-a306-7b3c706c3d24 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:56.284524 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-4a3b9903-47a3-456c-a306-7b3c706c3d24 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:56.284676 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-acd7fb16-efc7-45da-9078-9696deeca5e4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:56.285449 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-acd7fb16-efc7-45da-9078-9696deeca5e4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:56.292070 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4a3b9903-47a3-456c-a306-7b3c706c3d24 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:56.292739 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-acd7fb16-efc7-45da-9078-9696deeca5e4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:56.293133 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4a3b9903-47a3-456c-a306-7b3c706c3d24 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:56.293781 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4a3b9903-47a3-456c-a306-7b3c706c3d24 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:56.293907 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-acd7fb16-efc7-45da-9078-9696deeca5e4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:56.294655 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-acd7fb16-efc7-45da-9078-9696deeca5e4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:56.295025 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4a3b9903-47a3-456c-a306-7b3c706c3d24 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:56.295402 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-acd7fb16-efc7-45da-9078-9696deeca5e4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:56.295514 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4a3b9903-47a3-456c-a306-7b3c706c3d24 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:56.295821 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-acd7fb16-efc7-45da-9078-9696deeca5e4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:56.295941 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4a3b9903-47a3-456c-a306-7b3c706c3d24 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:56.296248 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-acd7fb16-efc7-45da-9078-9696deeca5e4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:56.510458 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-acd7fb16-efc7-45da-9078-9696deeca5e4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:56.514429 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4a3b9903-47a3-456c-a306-7b3c706c3d24 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:56.520152 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-acd7fb16-efc7-45da-9078-9696deeca5e4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:56.521698 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-acd7fb16-efc7-45da-9078-9696deeca5e4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:56.522913 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-acd7fb16-efc7-45da-9078-9696deeca5e4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1807 microversion: 2.20 time: 0.250402 Aug 24 03:33:56.523473 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 224/442] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:56 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1807 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:33:56.524333 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4a3b9903-47a3-456c-a306-7b3c706c3d24 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1735 microversion: 2.1 time: 0.258676 Aug 24 03:33:56.524971 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 219/443] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:56 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1735 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:33:57.545104 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-859fa783-00f2-485b-9634-7d321c2f258a tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:57.545722 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-859fa783-00f2-485b-9634-7d321c2f258a tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:57.547229 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-69ec345f-03b8-46bc-ac86-ac2d1422f3bf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:57.547843 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-69ec345f-03b8-46bc-ac86-ac2d1422f3bf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:57.550426 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:57.552274 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-859fa783-00f2-485b-9634-7d321c2f258a tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:57.552868 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-859fa783-00f2-485b-9634-7d321c2f258a tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:57.553311 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-859fa783-00f2-485b-9634-7d321c2f258a tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:57.554014 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-859fa783-00f2-485b-9634-7d321c2f258a tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:57.554586 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-859fa783-00f2-485b-9634-7d321c2f258a tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:57.554906 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-859fa783-00f2-485b-9634-7d321c2f258a tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:57.555555 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-69ec345f-03b8-46bc-ac86-ac2d1422f3bf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:57.556052 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-69ec345f-03b8-46bc-ac86-ac2d1422f3bf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:57.556494 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-69ec345f-03b8-46bc-ac86-ac2d1422f3bf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:57.557251 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-69ec345f-03b8-46bc-ac86-ac2d1422f3bf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:57.557713 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-69ec345f-03b8-46bc-ac86-ac2d1422f3bf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:57.558146 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-69ec345f-03b8-46bc-ac86-ac2d1422f3bf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:57.559023 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:33:57.773065 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-859fa783-00f2-485b-9634-7d321c2f258a tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:57.776285 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-69ec345f-03b8-46bc-ac86-ac2d1422f3bf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:57.781464 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-859fa783-00f2-485b-9634-7d321c2f258a tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1735 microversion: 2.1 time: 0.240322 Aug 24 03:33:57.782254 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 225/444] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:57 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1735 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:57.785444 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-69ec345f-03b8-46bc-ac86-ac2d1422f3bf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:57.787039 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-69ec345f-03b8-46bc-ac86-ac2d1422f3bf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:57.788261 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-69ec345f-03b8-46bc-ac86-ac2d1422f3bf tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1807 microversion: 2.20 time: 0.244862 Aug 24 03:33:57.789090 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 220/445] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:57 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1807 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:33:58.803283 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-8363609e-3850-47f8-b28c-b619a84bba89 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:58.803871 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-8363609e-3850-47f8-b28c-b619a84bba89 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:58.810474 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8363609e-3850-47f8-b28c-b619a84bba89 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:58.810960 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8363609e-3850-47f8-b28c-b619a84bba89 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:58.811235 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d5d9f206-b5e7-4337-a7c0-b745045a9b51 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:33:58.811651 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8363609e-3850-47f8-b28c-b619a84bba89 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:58.811852 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d5d9f206-b5e7-4337-a7c0-b745045a9b51 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:33:58.812074 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8363609e-3850-47f8-b28c-b619a84bba89 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:58.812525 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8363609e-3850-47f8-b28c-b619a84bba89 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:58.812980 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8363609e-3850-47f8-b28c-b619a84bba89 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:58.819175 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d5d9f206-b5e7-4337-a7c0-b745045a9b51 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:58.819661 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d5d9f206-b5e7-4337-a7c0-b745045a9b51 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:58.820099 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d5d9f206-b5e7-4337-a7c0-b745045a9b51 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:58.820832 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d5d9f206-b5e7-4337-a7c0-b745045a9b51 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:33:58.821293 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d5d9f206-b5e7-4337-a7c0-b745045a9b51 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:33:58.821720 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d5d9f206-b5e7-4337-a7c0-b745045a9b51 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:33:59.012564 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-8363609e-3850-47f8-b28c-b619a84bba89 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:59.020827 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d5d9f206-b5e7-4337-a7c0-b745045a9b51 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:59.021528 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-8363609e-3850-47f8-b28c-b619a84bba89 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1735 microversion: 2.1 time: 0.222172 Aug 24 03:33:59.022112 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 226/446] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:33:58 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1735 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:33:59.029462 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d5d9f206-b5e7-4337-a7c0-b745045a9b51 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:59.030949 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d5d9f206-b5e7-4337-a7c0-b745045a9b51 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:33:59.032088 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d5d9f206-b5e7-4337-a7c0-b745045a9b51 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1807 microversion: 2.20 time: 0.224741 Aug 24 03:33:59.032633 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 221/447] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:33:58 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1807 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:34:00.043128 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-d762b84f-6889-49ca-9f32-6b32df54df8a tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:00.044355 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-d762b84f-6889-49ca-9f32-6b32df54df8a tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:00.051142 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d762b84f-6889-49ca-9f32-6b32df54df8a tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:00.051636 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d762b84f-6889-49ca-9f32-6b32df54df8a tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:00.052078 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d762b84f-6889-49ca-9f32-6b32df54df8a tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:00.052798 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d762b84f-6889-49ca-9f32-6b32df54df8a tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:00.053272 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d762b84f-6889-49ca-9f32-6b32df54df8a tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:00.053703 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d762b84f-6889-49ca-9f32-6b32df54df8a tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:00.055110 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ede1ffb1-9253-456b-b1a1-b7f636a9f2c6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:00.055730 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ede1ffb1-9253-456b-b1a1-b7f636a9f2c6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:00.062144 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ede1ffb1-9253-456b-b1a1-b7f636a9f2c6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:00.062631 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ede1ffb1-9253-456b-b1a1-b7f636a9f2c6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:00.063069 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ede1ffb1-9253-456b-b1a1-b7f636a9f2c6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:00.063808 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ede1ffb1-9253-456b-b1a1-b7f636a9f2c6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:00.064393 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ede1ffb1-9253-456b-b1a1-b7f636a9f2c6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:00.064937 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ede1ffb1-9253-456b-b1a1-b7f636a9f2c6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:00.248237 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-d762b84f-6889-49ca-9f32-6b32df54df8a tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:00.252242 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ede1ffb1-9253-456b-b1a1-b7f636a9f2c6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:00.256727 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-d762b84f-6889-49ca-9f32-6b32df54df8a tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1735 microversion: 2.1 time: 0.217598 Aug 24 03:34:00.257529 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 227/448] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:00 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1735 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:00.261007 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ede1ffb1-9253-456b-b1a1-b7f636a9f2c6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:00.262522 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ede1ffb1-9253-456b-b1a1-b7f636a9f2c6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:00.263814 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ede1ffb1-9253-456b-b1a1-b7f636a9f2c6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1807 microversion: 2.20 time: 0.212491 Aug 24 03:34:00.264359 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 222/449] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:34:00 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1807 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:34:01.279025 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-915fb6c6-f723-4d48-952e-214fb1a0590b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:01.279566 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-915fb6c6-f723-4d48-952e-214fb1a0590b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:01.288294 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-86972621-a6a1-492b-a291-8eb8a00c4610 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:01.289573 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-86972621-a6a1-492b-a291-8eb8a00c4610 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:01.289876 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-915fb6c6-f723-4d48-952e-214fb1a0590b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:01.290432 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-915fb6c6-f723-4d48-952e-214fb1a0590b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:01.291218 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-915fb6c6-f723-4d48-952e-214fb1a0590b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:01.292238 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-915fb6c6-f723-4d48-952e-214fb1a0590b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:01.292715 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-915fb6c6-f723-4d48-952e-214fb1a0590b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:01.293183 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-915fb6c6-f723-4d48-952e-214fb1a0590b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:01.296483 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-86972621-a6a1-492b-a291-8eb8a00c4610 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:01.296998 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-86972621-a6a1-492b-a291-8eb8a00c4610 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:01.297498 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-86972621-a6a1-492b-a291-8eb8a00c4610 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:01.299453 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-86972621-a6a1-492b-a291-8eb8a00c4610 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:01.299940 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-86972621-a6a1-492b-a291-8eb8a00c4610 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:01.300368 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-86972621-a6a1-492b-a291-8eb8a00c4610 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:01.503322 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-915fb6c6-f723-4d48-952e-214fb1a0590b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:01.507771 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-86972621-a6a1-492b-a291-8eb8a00c4610 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:01.511553 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-915fb6c6-f723-4d48-952e-214fb1a0590b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1735 microversion: 2.1 time: 0.236642 Aug 24 03:34:01.512116 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 228/450] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:01 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1735 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:01.516600 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-86972621-a6a1-492b-a291-8eb8a00c4610 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:01.518917 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-86972621-a6a1-492b-a291-8eb8a00c4610 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:01.520074 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-86972621-a6a1-492b-a291-8eb8a00c4610 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1807 microversion: 2.20 time: 0.235975 Aug 24 03:34:01.520625 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 223/451] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:34:01 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1807 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:34:02.533755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-2dd33072-4c96-48e3-920d-7f38a0f64987 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:02.534368 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-2dd33072-4c96-48e3-920d-7f38a0f64987 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:02.540966 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2dd33072-4c96-48e3-920d-7f38a0f64987 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:02.541459 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2dd33072-4c96-48e3-920d-7f38a0f64987 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:02.541905 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2dd33072-4c96-48e3-920d-7f38a0f64987 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:02.542568 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-11752bcd-6e9d-4d38-af48-b91cd9c7eb8a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:02.543016 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2dd33072-4c96-48e3-920d-7f38a0f64987 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:02.543114 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2dd33072-4c96-48e3-920d-7f38a0f64987 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:02.543216 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-11752bcd-6e9d-4d38-af48-b91cd9c7eb8a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:02.543473 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2dd33072-4c96-48e3-920d-7f38a0f64987 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:02.549852 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-11752bcd-6e9d-4d38-af48-b91cd9c7eb8a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:02.550333 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-11752bcd-6e9d-4d38-af48-b91cd9c7eb8a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:02.550777 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-11752bcd-6e9d-4d38-af48-b91cd9c7eb8a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:02.551476 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-11752bcd-6e9d-4d38-af48-b91cd9c7eb8a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:02.551931 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-11752bcd-6e9d-4d38-af48-b91cd9c7eb8a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:02.552368 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-11752bcd-6e9d-4d38-af48-b91cd9c7eb8a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:02.744952 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-2dd33072-4c96-48e3-920d-7f38a0f64987 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:02.749003 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-11752bcd-6e9d-4d38-af48-b91cd9c7eb8a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:02.753288 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-2dd33072-4c96-48e3-920d-7f38a0f64987 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1735 microversion: 2.1 time: 0.224076 Aug 24 03:34:02.753866 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 229/452] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:02 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1735 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:02.757837 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-11752bcd-6e9d-4d38-af48-b91cd9c7eb8a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:02.759366 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-11752bcd-6e9d-4d38-af48-b91cd9c7eb8a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:02.760504 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-11752bcd-6e9d-4d38-af48-b91cd9c7eb8a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1807 microversion: 2.20 time: 0.221807 Aug 24 03:34:02.761081 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 224/453] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:34:02 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1807 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:34:03.774938 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-a7517503-8e26-4be2-a04a-e6998d053d02 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:03.775659 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-a7517503-8e26-4be2-a04a-e6998d053d02 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:03.782887 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a7517503-8e26-4be2-a04a-e6998d053d02 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:03.783403 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a7517503-8e26-4be2-a04a-e6998d053d02 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:03.783835 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a7517503-8e26-4be2-a04a-e6998d053d02 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:03.784527 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a7517503-8e26-4be2-a04a-e6998d053d02 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:03.785055 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a7517503-8e26-4be2-a04a-e6998d053d02 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:03.785500 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a7517503-8e26-4be2-a04a-e6998d053d02 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:03.793003 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1148d08f-5f54-413f-b49c-63e49d411230 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:03.793625 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1148d08f-5f54-413f-b49c-63e49d411230 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:03.801626 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1148d08f-5f54-413f-b49c-63e49d411230 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:03.802244 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1148d08f-5f54-413f-b49c-63e49d411230 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:03.802691 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1148d08f-5f54-413f-b49c-63e49d411230 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:03.803398 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1148d08f-5f54-413f-b49c-63e49d411230 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:03.803851 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1148d08f-5f54-413f-b49c-63e49d411230 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:03.804284 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1148d08f-5f54-413f-b49c-63e49d411230 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:03.821111 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=100 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:03.974469 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-a7517503-8e26-4be2-a04a-e6998d053d02 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:03.983298 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-a7517503-8e26-4be2-a04a-e6998d053d02 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1735 microversion: 2.1 time: 0.212397 Aug 24 03:34:03.984191 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 230/454] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:03 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1735 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:03.996486 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1148d08f-5f54-413f-b49c-63e49d411230 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:04.005748 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1148d08f-5f54-413f-b49c-63e49d411230 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:04.007253 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1148d08f-5f54-413f-b49c-63e49d411230 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:04.008406 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1148d08f-5f54-413f-b49c-63e49d411230 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1807 microversion: 2.20 time: 0.229253 Aug 24 03:34:04.008987 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 225/455] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:34:03 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1807 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:34:05.004759 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-89d73497-35bf-4a77-9565-838f2424ebf0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:05.005389 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-89d73497-35bf-4a77-9565-838f2424ebf0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:05.011794 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-89d73497-35bf-4a77-9565-838f2424ebf0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:05.012286 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-89d73497-35bf-4a77-9565-838f2424ebf0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:05.012731 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-89d73497-35bf-4a77-9565-838f2424ebf0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:05.013455 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-89d73497-35bf-4a77-9565-838f2424ebf0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:05.013918 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-89d73497-35bf-4a77-9565-838f2424ebf0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:05.014349 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-89d73497-35bf-4a77-9565-838f2424ebf0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:05.031370 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-fa7b38c3-b4b0-489c-aa8a-5ad1f5f1e5e8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:05.032578 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-fa7b38c3-b4b0-489c-aa8a-5ad1f5f1e5e8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:05.039098 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fa7b38c3-b4b0-489c-aa8a-5ad1f5f1e5e8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:05.039585 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fa7b38c3-b4b0-489c-aa8a-5ad1f5f1e5e8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:05.040020 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fa7b38c3-b4b0-489c-aa8a-5ad1f5f1e5e8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:05.040806 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fa7b38c3-b4b0-489c-aa8a-5ad1f5f1e5e8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:05.041270 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fa7b38c3-b4b0-489c-aa8a-5ad1f5f1e5e8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:05.041695 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fa7b38c3-b4b0-489c-aa8a-5ad1f5f1e5e8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:05.212624 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-89d73497-35bf-4a77-9565-838f2424ebf0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:05.216815 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-fa7b38c3-b4b0-489c-aa8a-5ad1f5f1e5e8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:05.221359 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-89d73497-35bf-4a77-9565-838f2424ebf0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1735 microversion: 2.1 time: 0.220431 Aug 24 03:34:05.221927 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 231/456] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:04 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1735 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:05.226620 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-fa7b38c3-b4b0-489c-aa8a-5ad1f5f1e5e8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:05.228178 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-fa7b38c3-b4b0-489c-aa8a-5ad1f5f1e5e8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:05.229383 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-fa7b38c3-b4b0-489c-aa8a-5ad1f5f1e5e8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1807 microversion: 2.20 time: 0.201881 Aug 24 03:34:05.229934 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 226/457] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:34:05 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1807 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:34:06.243937 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-747775da-3ce1-413a-940a-55d3ae08c29b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:06.244461 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-747775da-3ce1-413a-940a-55d3ae08c29b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:06.251057 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-747775da-3ce1-413a-940a-55d3ae08c29b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:06.251550 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-747775da-3ce1-413a-940a-55d3ae08c29b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:06.251994 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-747775da-3ce1-413a-940a-55d3ae08c29b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:06.252575 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-80b30e07-a4d0-4e61-9fb6-bceb92e9d69b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:06.253046 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-747775da-3ce1-413a-940a-55d3ae08c29b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:06.253344 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-747775da-3ce1-413a-940a-55d3ae08c29b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:06.253459 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-80b30e07-a4d0-4e61-9fb6-bceb92e9d69b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:06.253618 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-747775da-3ce1-413a-940a-55d3ae08c29b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:06.259571 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-80b30e07-a4d0-4e61-9fb6-bceb92e9d69b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:06.260056 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-80b30e07-a4d0-4e61-9fb6-bceb92e9d69b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:06.260493 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-80b30e07-a4d0-4e61-9fb6-bceb92e9d69b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:06.261218 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-80b30e07-a4d0-4e61-9fb6-bceb92e9d69b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:06.261671 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-80b30e07-a4d0-4e61-9fb6-bceb92e9d69b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:06.262096 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-80b30e07-a4d0-4e61-9fb6-bceb92e9d69b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:06.445566 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-747775da-3ce1-413a-940a-55d3ae08c29b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:06.452181 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-80b30e07-a4d0-4e61-9fb6-bceb92e9d69b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:06.453676 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-747775da-3ce1-413a-940a-55d3ae08c29b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1735 microversion: 2.1 time: 0.213675 Aug 24 03:34:06.454268 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 232/458] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:06 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1735 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:06.458889 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-32df2157-54c5-479c-8063-0edc55b17c58 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:06.461183 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-32df2157-54c5-479c-8063-0edc55b17c58 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:06.462178 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-80b30e07-a4d0-4e61-9fb6-bceb92e9d69b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:06.463972 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-80b30e07-a4d0-4e61-9fb6-bceb92e9d69b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:06.464902 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-80b30e07-a4d0-4e61-9fb6-bceb92e9d69b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1807 microversion: 2.20 time: 0.216383 Aug 24 03:34:06.465457 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 227/459] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:34:06 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1807 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:34:06.467858 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-32df2157-54c5-479c-8063-0edc55b17c58 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:06.468355 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-32df2157-54c5-479c-8063-0edc55b17c58 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:06.468997 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-32df2157-54c5-479c-8063-0edc55b17c58 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:06.470527 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-32df2157-54c5-479c-8063-0edc55b17c58 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:06.471105 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-32df2157-54c5-479c-8063-0edc55b17c58 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:06.471542 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-32df2157-54c5-479c-8063-0edc55b17c58 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:06.546192 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-32df2157-54c5-479c-8063-0edc55b17c58 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "POST /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f/action" status: 202 len: 0 microversion: 2.1 time: 0.090566 Aug 24 03:34:06.546732 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 233/460] 10.222.0.81 () {60 vars in 1278 bytes} [Wed Aug 24 03:34:06 2022] POST /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:34:06.555362 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-9d5f438c-de8e-4f49-a0ee-34289becef64 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:06.555976 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-9d5f438c-de8e-4f49-a0ee-34289becef64 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:06.561842 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9d5f438c-de8e-4f49-a0ee-34289becef64 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:06.562313 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9d5f438c-de8e-4f49-a0ee-34289becef64 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:06.562740 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9d5f438c-de8e-4f49-a0ee-34289becef64 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:06.563571 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9d5f438c-de8e-4f49-a0ee-34289becef64 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:06.564015 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9d5f438c-de8e-4f49-a0ee-34289becef64 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:06.564433 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9d5f438c-de8e-4f49-a0ee-34289becef64 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:06.707692 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-9d5f438c-de8e-4f49-a0ee-34289becef64 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:06.715858 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-9d5f438c-de8e-4f49-a0ee-34289becef64 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1748 microversion: 2.1 time: 0.164296 Aug 24 03:34:06.716421 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 228/461] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:06 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1748 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:07.477194 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-e6f0f164-8c17-4caf-8fea-945aeb413076 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:07.477828 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-e6f0f164-8c17-4caf-8fea-945aeb413076 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:07.485954 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e6f0f164-8c17-4caf-8fea-945aeb413076 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:07.486451 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e6f0f164-8c17-4caf-8fea-945aeb413076 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:07.486894 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e6f0f164-8c17-4caf-8fea-945aeb413076 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:07.487604 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e6f0f164-8c17-4caf-8fea-945aeb413076 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:07.488101 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e6f0f164-8c17-4caf-8fea-945aeb413076 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:07.488676 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e6f0f164-8c17-4caf-8fea-945aeb413076 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:07.492230 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c48e5cb1-c817-4d6d-90da-b2af547f357b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:07.493960 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c48e5cb1-c817-4d6d-90da-b2af547f357b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:07.501457 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c48e5cb1-c817-4d6d-90da-b2af547f357b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:07.502493 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c48e5cb1-c817-4d6d-90da-b2af547f357b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:07.503423 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c48e5cb1-c817-4d6d-90da-b2af547f357b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:07.504490 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c48e5cb1-c817-4d6d-90da-b2af547f357b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:07.505198 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c48e5cb1-c817-4d6d-90da-b2af547f357b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:07.505857 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c48e5cb1-c817-4d6d-90da-b2af547f357b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:07.711360 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-e6f0f164-8c17-4caf-8fea-945aeb413076 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:07.722899 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c48e5cb1-c817-4d6d-90da-b2af547f357b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:07.725069 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-e6f0f164-8c17-4caf-8fea-945aeb413076 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1715 microversion: 2.1 time: 0.252432 Aug 24 03:34:07.737143 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c48e5cb1-c817-4d6d-90da-b2af547f357b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:07.738893 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c48e5cb1-c817-4d6d-90da-b2af547f357b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:07.740785 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c48e5cb1-c817-4d6d-90da-b2af547f357b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1807 microversion: 2.20 time: 0.255418 Aug 24 03:34:07.741150 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 234/462] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:07 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1715 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:07.742418 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 229/463] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:34:07 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1807 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:34:07.752899 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-ec383a43-5e72-4a43-971d-60fdb1cad9a8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:07.753528 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-ec383a43-5e72-4a43-971d-60fdb1cad9a8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:07.760281 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ec383a43-5e72-4a43-971d-60fdb1cad9a8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:07.760804 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ec383a43-5e72-4a43-971d-60fdb1cad9a8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:07.761244 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ec383a43-5e72-4a43-971d-60fdb1cad9a8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:07.761949 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ec383a43-5e72-4a43-971d-60fdb1cad9a8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:07.762402 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ec383a43-5e72-4a43-971d-60fdb1cad9a8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:07.762836 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ec383a43-5e72-4a43-971d-60fdb1cad9a8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:07.856129 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-da71412a-03f8-472b-96e9-9a3f68c23501 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:07.856625 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-da71412a-03f8-472b-96e9-9a3f68c23501 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:07.862935 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-da71412a-03f8-472b-96e9-9a3f68c23501 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:07.863427 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-da71412a-03f8-472b-96e9-9a3f68c23501 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:07.863866 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-da71412a-03f8-472b-96e9-9a3f68c23501 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:07.864559 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-da71412a-03f8-472b-96e9-9a3f68c23501 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:07.865052 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-da71412a-03f8-472b-96e9-9a3f68c23501 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:07.865467 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-da71412a-03f8-472b-96e9-9a3f68c23501 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:07.913785 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-ec383a43-5e72-4a43-971d-60fdb1cad9a8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:07.941796 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-ec383a43-5e72-4a43-971d-60fdb1cad9a8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1748 microversion: 2.1 time: 0.193214 Aug 24 03:34:07.942668 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 235/464] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:07 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1748 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:07.960604 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-da71412a-03f8-472b-96e9-9a3f68c23501 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] HTTP exception thrown: Cannot 'detach_volume' instance 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 while it is in vm_state rescued Aug 24 03:34:07.962259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-da71412a-03f8-472b-96e9-9a3f68c23501 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Request method failure captured: Aug 24 03:34:07.962259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: request: DELETE /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280/os-volume_attachments/55ea0a6f-9c4d-4d85-86ab-0b3492bd1cbc HTTP/1.1 Aug 24 03:34:07.962259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 24 03:34:07.962259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 24 03:34:07.962259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Connection: close Aug 24 03:34:07.962259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 24 03:34:07.962259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 24 03:34:07.962259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Host: 10.222.0.81 Aug 24 03:34:07.962259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 24 03:34:07.962259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.11 Aug 24 03:34:07.962259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjBZtELohYIAWnqjydeh3nWBVxVzNmFojSvJiXirJze4xCW5UrBoFNDSrYI2MQuwDBgKCF0rIi4_RidefSOe-gruz8glzTk9P0i0YWWK0Ls_tkgBqEsg07AX095VUNsx8SXSrVeXxD-FtuxDYQ-PAYt2BeP7o3wF-sE_NMuIwVCtJS2k0 Aug 24 03:34:07.962259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 24 03:34:07.962259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 24 03:34:07.962259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 24 03:34:07.962259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 24 03:34:07.962259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 24 03:34:07.962259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 24 03:34:07.962259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Id: 625e6391470e4018a6c502219b3d2b15 Aug 24 03:34:07.962259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1294945241 Aug 24 03:34:07.962259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 24 03:34:07.962259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 24 03:34:07.963864 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/625e6391470e4018a6c502219b3d2b15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_625e6391470e4018a6c502219b3d2b15", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/625e6391470e4018a6c502219b3d2b15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/625e6391470e4018a6c502219b3d2b15"}]}] Aug 24 03:34:07.963864 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1294945241 Aug 24 03:34:07.963864 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 625e6391470e4018a6c502219b3d2b15 Aug 24 03:34:07.963864 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1294945241 Aug 24 03:34:07.963864 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User: tempest-ServerRescueNegativeTestJSON-1294945241-project Aug 24 03:34:07.963864 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 24 03:34:07.963864 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 24 03:34:07.963864 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Id: 33b932f3feb342d889155c3c34407a88 Aug 24 03:34:07.963864 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1294945241-project Aug 24 03:34:07.963864 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: method: > Aug 24 03:34:07.963864 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: exception: Cannot 'detach_volume' instance 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 while it is in vm_state rescued Aug 24 03:34:07.964538 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: action_args: {'server_id': '76a6c958-f0bd-4b52-ab2c-15ff7e7b1280', 'id': '55ea0a6f-9c4d-4d85-86ab-0b3492bd1cbc'} Aug 24 03:34:07.964538 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:34:07.964538 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:07.964538 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 03:34:07.964538 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 03:34:07.964538 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 03:34:07.964538 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:34:07.964538 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 03:34:07.964538 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 03:34:07.964538 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 03:34:07.964538 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:34:07.964538 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:34:07.964538 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:34:07.964538 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:07.964538 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:34:07.964538 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:34:07.964538 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:34:07.964538 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:34:07.964538 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:34:07.964538 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:34:07.965936 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 03:34:07.965936 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 03:34:07.965936 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 03:34:07.965936 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 03:34:07.965936 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 while it is in vm_state rescued Aug 24 03:34:07.965936 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:34:07.965936 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:34:07.965936 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:34:07.965936 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:07.965936 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:34:07.965936 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:34:07.965936 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:34:07.965936 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:34:07.965936 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 while it is in vm_state rescued Aug 24 03:34:07.965936 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:34:07.965936 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-da71412a-03f8-472b-96e9-9a3f68c23501 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Returning 409 to user: Cannot 'detach_volume' instance 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 while it is in vm_state rescued {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:34:07.967082 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-da71412a-03f8-472b-96e9-9a3f68c23501 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "DELETE /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280/os-volume_attachments/55ea0a6f-9c4d-4d85-86ab-0b3492bd1cbc" status: 409 len: 152 microversion: 2.1 time: 0.111518 Aug 24 03:34:07.967082 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 230/465] 10.222.0.81 () {58 vars in 1416 bytes} [Wed Aug 24 03:34:07 2022] DELETE /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280/os-volume_attachments/55ea0a6f-9c4d-4d85-86ab-0b3492bd1cbc => generated 152 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 24 03:34:07.973095 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-763604f7-52fe-4b7a-b972-9b1a167c2278 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:07.973654 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-763604f7-52fe-4b7a-b972-9b1a167c2278 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:07.979903 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-763604f7-52fe-4b7a-b972-9b1a167c2278 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:07.980393 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-763604f7-52fe-4b7a-b972-9b1a167c2278 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:07.980870 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-763604f7-52fe-4b7a-b972-9b1a167c2278 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:07.981561 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-763604f7-52fe-4b7a-b972-9b1a167c2278 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:07.982112 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-763604f7-52fe-4b7a-b972-9b1a167c2278 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:07.982541 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-763604f7-52fe-4b7a-b972-9b1a167c2278 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:08.048482 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-763604f7-52fe-4b7a-b972-9b1a167c2278 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "POST /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280/action" status: 202 len: 0 microversion: 2.1 time: 0.079330 Aug 24 03:34:08.049153 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 236/466] 10.222.0.81 () {60 vars in 1278 bytes} [Wed Aug 24 03:34:07 2022] POST /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:34:08.057355 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-954cc701-e6d5-461c-adb0-5848ca28ef2c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:08.057970 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-954cc701-e6d5-461c-adb0-5848ca28ef2c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:08.064630 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-954cc701-e6d5-461c-adb0-5848ca28ef2c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:08.065142 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-954cc701-e6d5-461c-adb0-5848ca28ef2c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:08.065583 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-954cc701-e6d5-461c-adb0-5848ca28ef2c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:08.066276 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-954cc701-e6d5-461c-adb0-5848ca28ef2c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:08.066732 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-954cc701-e6d5-461c-adb0-5848ca28ef2c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:08.067159 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-954cc701-e6d5-461c-adb0-5848ca28ef2c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:08.213793 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-954cc701-e6d5-461c-adb0-5848ca28ef2c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:08.222745 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-954cc701-e6d5-461c-adb0-5848ca28ef2c tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1723 microversion: 2.1 time: 0.169173 Aug 24 03:34:08.223324 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 231/467] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:08 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:08.771465 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-b198e374-b95f-43e4-8e94-9b207a2d3f3e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:08.772077 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-b198e374-b95f-43e4-8e94-9b207a2d3f3e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:08.778051 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b198e374-b95f-43e4-8e94-9b207a2d3f3e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:08.778523 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b198e374-b95f-43e4-8e94-9b207a2d3f3e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:08.778954 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b198e374-b95f-43e4-8e94-9b207a2d3f3e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:08.779642 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b198e374-b95f-43e4-8e94-9b207a2d3f3e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:08.780085 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b198e374-b95f-43e4-8e94-9b207a2d3f3e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:08.780501 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b198e374-b95f-43e4-8e94-9b207a2d3f3e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:08.910291 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-b198e374-b95f-43e4-8e94-9b207a2d3f3e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:08.918996 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-b198e374-b95f-43e4-8e94-9b207a2d3f3e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:08.920525 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-b198e374-b95f-43e4-8e94-9b207a2d3f3e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:08.921739 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-b198e374-b95f-43e4-8e94-9b207a2d3f3e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1807 microversion: 2.20 time: 0.155119 Aug 24 03:34:08.922933 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 237/468] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:34:08 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:34:08.964563 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0be3fa27-df77-4966-acd9-b9b25660751f tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:08.965277 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0be3fa27-df77-4966-acd9-b9b25660751f tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:08.972687 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0be3fa27-df77-4966-acd9-b9b25660751f tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:08.973208 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0be3fa27-df77-4966-acd9-b9b25660751f tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:08.973647 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0be3fa27-df77-4966-acd9-b9b25660751f tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:08.974371 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0be3fa27-df77-4966-acd9-b9b25660751f tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:08.975097 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0be3fa27-df77-4966-acd9-b9b25660751f tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:08.975522 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0be3fa27-df77-4966-acd9-b9b25660751f tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:09.116043 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0be3fa27-df77-4966-acd9-b9b25660751f tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:09.124151 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0be3fa27-df77-4966-acd9-b9b25660751f tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1753 microversion: 2.1 time: 0.163450 Aug 24 03:34:09.124722 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 232/469] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:08 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:09.243251 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-b198eb6f-a62f-4941-8b5e-f64207d57496 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:09.243854 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-b198eb6f-a62f-4941-8b5e-f64207d57496 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:09.249687 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b198eb6f-a62f-4941-8b5e-f64207d57496 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:09.250165 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b198eb6f-a62f-4941-8b5e-f64207d57496 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:09.250599 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b198eb6f-a62f-4941-8b5e-f64207d57496 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:09.251393 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b198eb6f-a62f-4941-8b5e-f64207d57496 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:09.251819 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b198eb6f-a62f-4941-8b5e-f64207d57496 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:09.252238 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b198eb6f-a62f-4941-8b5e-f64207d57496 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:09.388293 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-b198eb6f-a62f-4941-8b5e-f64207d57496 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:09.396593 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-b198eb6f-a62f-4941-8b5e-f64207d57496 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1723 microversion: 2.1 time: 0.157092 Aug 24 03:34:09.397186 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 238/470] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:09 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:09.629812 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-48ea37af-cd49-4958-8ecf-ccf92e60441f req-5135ae54-f51c-48cd-88b7-5cdc3c351728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a89effc-2ad4-414e-bca5-d503b48fb040", "name": "network-vif-plugged", "status": "completed", "tag": "57289a66-609a-46ea-b8c8-5258bbaf0864"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:09.640013 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-48ea37af-cd49-4958-8ecf-ccf92e60441f req-5135ae54-f51c-48cd-88b7-5cdc3c351728 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:09.640495 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-48ea37af-cd49-4958-8ecf-ccf92e60441f req-5135ae54-f51c-48cd-88b7-5cdc3c351728 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:09.640957 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-48ea37af-cd49-4958-8ecf-ccf92e60441f req-5135ae54-f51c-48cd-88b7-5cdc3c351728 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:09.653619 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-48ea37af-cd49-4958-8ecf-ccf92e60441f req-5135ae54-f51c-48cd-88b7-5cdc3c351728 service nova] Creating event network-vif-plugged:57289a66-609a-46ea-b8c8-5258bbaf0864 for instance 4a89effc-2ad4-414e-bca5-d503b48fb040 on hv-cinder-85426 Aug 24 03:34:09.659201 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-48ea37af-cd49-4958-8ecf-ccf92e60441f req-5135ae54-f51c-48cd-88b7-5cdc3c351728 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033264 Aug 24 03:34:09.659799 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 233/471] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:09.945442 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-0b0ac3d6-ec5a-475e-aabf-0e8066814c43 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:09.946056 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-0b0ac3d6-ec5a-475e-aabf-0e8066814c43 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:09.952416 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0b0ac3d6-ec5a-475e-aabf-0e8066814c43 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:09.952938 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0b0ac3d6-ec5a-475e-aabf-0e8066814c43 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:09.953379 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0b0ac3d6-ec5a-475e-aabf-0e8066814c43 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:09.954604 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0b0ac3d6-ec5a-475e-aabf-0e8066814c43 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:09.955282 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0b0ac3d6-ec5a-475e-aabf-0e8066814c43 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:09.955713 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0b0ac3d6-ec5a-475e-aabf-0e8066814c43 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:10.083750 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-0b0ac3d6-ec5a-475e-aabf-0e8066814c43 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:10.086041 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:10.093584 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-0b0ac3d6-ec5a-475e-aabf-0e8066814c43 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:10.095693 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-0b0ac3d6-ec5a-475e-aabf-0e8066814c43 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:10.096898 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-0b0ac3d6-ec5a-475e-aabf-0e8066814c43 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1807 microversion: 2.20 time: 0.155371 Aug 24 03:34:10.097441 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 239/472] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:34:09 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:34:10.147215 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-fb1f137c-ccc8-43c8-8c99-1e2d622b5155 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:10.147852 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-fb1f137c-ccc8-43c8-8c99-1e2d622b5155 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:10.154004 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fb1f137c-ccc8-43c8-8c99-1e2d622b5155 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:10.154483 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fb1f137c-ccc8-43c8-8c99-1e2d622b5155 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:10.154917 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fb1f137c-ccc8-43c8-8c99-1e2d622b5155 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:10.155614 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fb1f137c-ccc8-43c8-8c99-1e2d622b5155 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:10.156068 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fb1f137c-ccc8-43c8-8c99-1e2d622b5155 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:10.156494 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fb1f137c-ccc8-43c8-8c99-1e2d622b5155 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:10.418275 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-55276eb1-9e42-4661-a5b6-71872ea36bb6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:10.418807 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-55276eb1-9e42-4661-a5b6-71872ea36bb6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:10.427538 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-55276eb1-9e42-4661-a5b6-71872ea36bb6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:10.428030 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-55276eb1-9e42-4661-a5b6-71872ea36bb6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:10.429122 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-55276eb1-9e42-4661-a5b6-71872ea36bb6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:10.430043 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-55276eb1-9e42-4661-a5b6-71872ea36bb6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:10.430517 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-55276eb1-9e42-4661-a5b6-71872ea36bb6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:10.430947 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-55276eb1-9e42-4661-a5b6-71872ea36bb6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:10.571198 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-fb1f137c-ccc8-43c8-8c99-1e2d622b5155 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:10.579266 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-fb1f137c-ccc8-43c8-8c99-1e2d622b5155 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1753 microversion: 2.1 time: 0.436683 Aug 24 03:34:10.579840 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 234/473] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:10 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1753 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:10.633966 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-55276eb1-9e42-4661-a5b6-71872ea36bb6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:10.642082 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-55276eb1-9e42-4661-a5b6-71872ea36bb6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1723 microversion: 2.1 time: 0.227737 Aug 24 03:34:10.642643 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 240/474] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:10 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:11.120729 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b9b2d0a4-8d1b-421b-98ed-489266d1a412 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:11.121765 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-b9b2d0a4-8d1b-421b-98ed-489266d1a412 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:11.128262 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b9b2d0a4-8d1b-421b-98ed-489266d1a412 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:11.128749 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b9b2d0a4-8d1b-421b-98ed-489266d1a412 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:11.129209 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b9b2d0a4-8d1b-421b-98ed-489266d1a412 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:11.130016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b9b2d0a4-8d1b-421b-98ed-489266d1a412 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:11.130469 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b9b2d0a4-8d1b-421b-98ed-489266d1a412 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:11.130897 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b9b2d0a4-8d1b-421b-98ed-489266d1a412 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:11.262827 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-b9b2d0a4-8d1b-421b-98ed-489266d1a412 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:11.271941 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-b9b2d0a4-8d1b-421b-98ed-489266d1a412 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:11.273477 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-b9b2d0a4-8d1b-421b-98ed-489266d1a412 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:11.274619 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-b9b2d0a4-8d1b-421b-98ed-489266d1a412 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1807 microversion: 2.20 time: 0.159018 Aug 24 03:34:11.275159 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 235/475] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:34:11 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:34:11.600246 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-9373a8d6-a4ef-4c3a-a997-0d7170ef4e5a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:11.600876 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-9373a8d6-a4ef-4c3a-a997-0d7170ef4e5a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:11.606804 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9373a8d6-a4ef-4c3a-a997-0d7170ef4e5a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:11.607290 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9373a8d6-a4ef-4c3a-a997-0d7170ef4e5a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:11.607732 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9373a8d6-a4ef-4c3a-a997-0d7170ef4e5a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:11.608425 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9373a8d6-a4ef-4c3a-a997-0d7170ef4e5a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:11.608910 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9373a8d6-a4ef-4c3a-a997-0d7170ef4e5a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:11.609336 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9373a8d6-a4ef-4c3a-a997-0d7170ef4e5a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:11.663611 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-bb285a7f-0969-44de-a424-457b8fa88f46 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:11.664213 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-bb285a7f-0969-44de-a424-457b8fa88f46 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:11.671579 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bb285a7f-0969-44de-a424-457b8fa88f46 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:11.672069 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bb285a7f-0969-44de-a424-457b8fa88f46 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:11.673120 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bb285a7f-0969-44de-a424-457b8fa88f46 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:11.673826 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bb285a7f-0969-44de-a424-457b8fa88f46 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:11.674281 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bb285a7f-0969-44de-a424-457b8fa88f46 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:11.674698 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bb285a7f-0969-44de-a424-457b8fa88f46 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:11.825486 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-9373a8d6-a4ef-4c3a-a997-0d7170ef4e5a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:11.834989 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-9373a8d6-a4ef-4c3a-a997-0d7170ef4e5a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1753 microversion: 2.1 time: 0.238478 Aug 24 03:34:11.835236 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 241/476] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:11 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1753 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:11.858796 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-bb285a7f-0969-44de-a424-457b8fa88f46 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:11.866933 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-bb285a7f-0969-44de-a424-457b8fa88f46 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1729 microversion: 2.1 time: 0.207181 Aug 24 03:34:11.867494 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 236/477] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:11 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1729 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:11.887851 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-e1dab730-b6bd-4574-9f6a-25c915d0c2ec tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:11.888347 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-e1dab730-b6bd-4574-9f6a-25c915d0c2ec tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:11.895583 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e1dab730-b6bd-4574-9f6a-25c915d0c2ec tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:11.896077 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e1dab730-b6bd-4574-9f6a-25c915d0c2ec tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:11.896517 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e1dab730-b6bd-4574-9f6a-25c915d0c2ec tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:11.897331 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e1dab730-b6bd-4574-9f6a-25c915d0c2ec tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:11.897789 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e1dab730-b6bd-4574-9f6a-25c915d0c2ec tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:11.898215 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e1dab730-b6bd-4574-9f6a-25c915d0c2ec tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:11.978180 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-e1dab730-b6bd-4574-9f6a-25c915d0c2ec tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094125 Aug 24 03:34:11.978771 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 242/478] 10.222.0.81 () {58 vars in 1275 bytes} [Wed Aug 24 03:34:11 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:12.298136 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-3f7ecca6-4b08-4135-bec2-69dd0bbef2a9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:12.299038 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-3f7ecca6-4b08-4135-bec2-69dd0bbef2a9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:12.304865 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3f7ecca6-4b08-4135-bec2-69dd0bbef2a9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:12.305346 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3f7ecca6-4b08-4135-bec2-69dd0bbef2a9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:12.305775 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3f7ecca6-4b08-4135-bec2-69dd0bbef2a9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:12.306465 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3f7ecca6-4b08-4135-bec2-69dd0bbef2a9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:12.306908 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3f7ecca6-4b08-4135-bec2-69dd0bbef2a9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:12.307324 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3f7ecca6-4b08-4135-bec2-69dd0bbef2a9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:12.553936 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-3f7ecca6-4b08-4135-bec2-69dd0bbef2a9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:12.562997 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-3f7ecca6-4b08-4135-bec2-69dd0bbef2a9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:12.564871 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-3f7ecca6-4b08-4135-bec2-69dd0bbef2a9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:12.566078 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-3f7ecca6-4b08-4135-bec2-69dd0bbef2a9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1807 microversion: 2.20 time: 0.272682 Aug 24 03:34:12.566636 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 237/479] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:34:12 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1807 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:34:12.856192 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-8cb7ea8c-cc94-4e6c-bb3e-7b68904394f1 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:12.856945 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-8cb7ea8c-cc94-4e6c-bb3e-7b68904394f1 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:12.858851 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_api:SELECT=62 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:12.864266 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8cb7ea8c-cc94-4e6c-bb3e-7b68904394f1 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:12.864753 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8cb7ea8c-cc94-4e6c-bb3e-7b68904394f1 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:12.865215 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8cb7ea8c-cc94-4e6c-bb3e-7b68904394f1 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:12.865920 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8cb7ea8c-cc94-4e6c-bb3e-7b68904394f1 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:12.866378 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8cb7ea8c-cc94-4e6c-bb3e-7b68904394f1 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:12.866805 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8cb7ea8c-cc94-4e6c-bb3e-7b68904394f1 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:12.933073 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-a4d5686c-f7d0-4af9-b101-d69c1f8e3f8b req-573bf8e3-1939-4071-9bf3-88cbb97a2d26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76a6c958-f0bd-4b52-ab2c-15ff7e7b1280", "tag": "7def1576-8e43-41f3-b534-e7a7b46f1b54"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:12.942093 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-a4d5686c-f7d0-4af9-b101-d69c1f8e3f8b req-573bf8e3-1939-4071-9bf3-88cbb97a2d26 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:12.942834 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-a4d5686c-f7d0-4af9-b101-d69c1f8e3f8b req-573bf8e3-1939-4071-9bf3-88cbb97a2d26 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:12.943343 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-a4d5686c-f7d0-4af9-b101-d69c1f8e3f8b req-573bf8e3-1939-4071-9bf3-88cbb97a2d26 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:12.955328 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-a4d5686c-f7d0-4af9-b101-d69c1f8e3f8b req-573bf8e3-1939-4071-9bf3-88cbb97a2d26 service nova] Creating event network-changed:7def1576-8e43-41f3-b534-e7a7b46f1b54 for instance 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 on hv-cinder-85426 Aug 24 03:34:12.961137 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-a4d5686c-f7d0-4af9-b101-d69c1f8e3f8b req-573bf8e3-1939-4071-9bf3-88cbb97a2d26 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032934 Aug 24 03:34:12.961297 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 238/480] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:34:13.057712 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-8cb7ea8c-cc94-4e6c-bb3e-7b68904394f1 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:13.066606 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-8cb7ea8c-cc94-4e6c-bb3e-7b68904394f1 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1753 microversion: 2.1 time: 0.214749 Aug 24 03:34:13.067178 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 243/481] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:12 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1753 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:13.590429 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-5ea74165-5394-43a0-9bfa-81b6a7841754 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:13.591324 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-5ea74165-5394-43a0-9bfa-81b6a7841754 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:13.598041 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5ea74165-5394-43a0-9bfa-81b6a7841754 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:13.598525 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5ea74165-5394-43a0-9bfa-81b6a7841754 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:13.599229 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5ea74165-5394-43a0-9bfa-81b6a7841754 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:13.599918 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5ea74165-5394-43a0-9bfa-81b6a7841754 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:13.600372 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5ea74165-5394-43a0-9bfa-81b6a7841754 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:13.600821 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5ea74165-5394-43a0-9bfa-81b6a7841754 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:13.744639 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-5ea74165-5394-43a0-9bfa-81b6a7841754 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:13.762712 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-5ea74165-5394-43a0-9bfa-81b6a7841754 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:13.764059 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-5ea74165-5394-43a0-9bfa-81b6a7841754 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:13.767149 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-5ea74165-5394-43a0-9bfa-81b6a7841754 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1807 microversion: 2.20 time: 0.181418 Aug 24 03:34:13.770869 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 239/482] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:34:13 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:34:14.088664 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-d9d7716a-203a-4b54-ba1d-d0d612ea2969 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:14.089314 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-d9d7716a-203a-4b54-ba1d-d0d612ea2969 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:14.097131 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d9d7716a-203a-4b54-ba1d-d0d612ea2969 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:14.097774 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d9d7716a-203a-4b54-ba1d-d0d612ea2969 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:14.098271 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d9d7716a-203a-4b54-ba1d-d0d612ea2969 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:14.099336 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d9d7716a-203a-4b54-ba1d-d0d612ea2969 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:14.100047 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d9d7716a-203a-4b54-ba1d-d0d612ea2969 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:14.100486 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d9d7716a-203a-4b54-ba1d-d0d612ea2969 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:14.254492 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-d9d7716a-203a-4b54-ba1d-d0d612ea2969 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:14.263367 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-d9d7716a-203a-4b54-ba1d-d0d612ea2969 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1753 microversion: 2.1 time: 0.179343 Aug 24 03:34:14.264040 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 244/483] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:14 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1753 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:14.793439 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4c483051-f9bb-485a-8c2d-ddf347175e1a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:14.794050 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-4c483051-f9bb-485a-8c2d-ddf347175e1a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:14.801381 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4c483051-f9bb-485a-8c2d-ddf347175e1a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:14.801868 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4c483051-f9bb-485a-8c2d-ddf347175e1a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:14.802406 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4c483051-f9bb-485a-8c2d-ddf347175e1a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:14.803097 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4c483051-f9bb-485a-8c2d-ddf347175e1a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:14.803554 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4c483051-f9bb-485a-8c2d-ddf347175e1a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:14.803990 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4c483051-f9bb-485a-8c2d-ddf347175e1a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:14.935620 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4c483051-f9bb-485a-8c2d-ddf347175e1a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:14.944986 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4c483051-f9bb-485a-8c2d-ddf347175e1a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:14.946481 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4c483051-f9bb-485a-8c2d-ddf347175e1a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:14.947620 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4c483051-f9bb-485a-8c2d-ddf347175e1a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1794 microversion: 2.20 time: 0.158253 Aug 24 03:34:14.948170 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 240/484] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:34:14 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1794 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:34:14.974705 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-9a472164-2a67-4178-8729-a4b83f49e834 req-564fd560-0cf0-46f0-be57-2c8a27981d7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76a6c958-f0bd-4b52-ab2c-15ff7e7b1280", "tag": "7def1576-8e43-41f3-b534-e7a7b46f1b54"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:14.984023 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-9a472164-2a67-4178-8729-a4b83f49e834 req-564fd560-0cf0-46f0-be57-2c8a27981d7a service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:14.984503 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-9a472164-2a67-4178-8729-a4b83f49e834 req-564fd560-0cf0-46f0-be57-2c8a27981d7a service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:14.985228 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-9a472164-2a67-4178-8729-a4b83f49e834 req-564fd560-0cf0-46f0-be57-2c8a27981d7a service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:14.996272 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-9a472164-2a67-4178-8729-a4b83f49e834 req-564fd560-0cf0-46f0-be57-2c8a27981d7a service nova] Creating event network-changed:7def1576-8e43-41f3-b534-e7a7b46f1b54 for instance 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 on hv-cinder-85426 Aug 24 03:34:15.001541 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-9a472164-2a67-4178-8729-a4b83f49e834 req-564fd560-0cf0-46f0-be57-2c8a27981d7a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030775 Aug 24 03:34:15.002116 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 245/485] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:15.287441 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-fbb608de-2be1-4616-8360-0ce2beda55c2 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:15.288046 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-fbb608de-2be1-4616-8360-0ce2beda55c2 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:15.294116 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fbb608de-2be1-4616-8360-0ce2beda55c2 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:15.294594 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fbb608de-2be1-4616-8360-0ce2beda55c2 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:15.295026 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fbb608de-2be1-4616-8360-0ce2beda55c2 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:15.295708 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fbb608de-2be1-4616-8360-0ce2beda55c2 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:15.296157 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fbb608de-2be1-4616-8360-0ce2beda55c2 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:15.296577 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fbb608de-2be1-4616-8360-0ce2beda55c2 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:15.450452 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-fbb608de-2be1-4616-8360-0ce2beda55c2 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:15.459382 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-fbb608de-2be1-4616-8360-0ce2beda55c2 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1753 microversion: 2.1 time: 0.175577 Aug 24 03:34:15.460135 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 241/486] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:15 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1753 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:16.482992 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-82dee6d6-7616-4a37-a924-1c7aa756dc96 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:16.483619 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-82dee6d6-7616-4a37-a924-1c7aa756dc96 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:16.489817 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-82dee6d6-7616-4a37-a924-1c7aa756dc96 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:16.490299 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-82dee6d6-7616-4a37-a924-1c7aa756dc96 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:16.490765 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-82dee6d6-7616-4a37-a924-1c7aa756dc96 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:16.491452 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-82dee6d6-7616-4a37-a924-1c7aa756dc96 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:16.491905 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-82dee6d6-7616-4a37-a924-1c7aa756dc96 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:16.492355 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-82dee6d6-7616-4a37-a924-1c7aa756dc96 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:16.638397 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-82dee6d6-7616-4a37-a924-1c7aa756dc96 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:16.646799 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-82dee6d6-7616-4a37-a924-1c7aa756dc96 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1753 microversion: 2.1 time: 0.168746 Aug 24 03:34:16.647359 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 246/487] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:16 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:17.667745 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-814c5af1-5ca8-4cb6-bc54-68df0f6f91bd tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:17.668346 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-814c5af1-5ca8-4cb6-bc54-68df0f6f91bd tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:17.676117 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-814c5af1-5ca8-4cb6-bc54-68df0f6f91bd tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:17.676600 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-814c5af1-5ca8-4cb6-bc54-68df0f6f91bd tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:17.677064 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-814c5af1-5ca8-4cb6-bc54-68df0f6f91bd tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:17.677756 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-814c5af1-5ca8-4cb6-bc54-68df0f6f91bd tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:17.678208 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-814c5af1-5ca8-4cb6-bc54-68df0f6f91bd tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:17.678631 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-814c5af1-5ca8-4cb6-bc54-68df0f6f91bd tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:17.819300 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-814c5af1-5ca8-4cb6-bc54-68df0f6f91bd tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:17.827532 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-814c5af1-5ca8-4cb6-bc54-68df0f6f91bd tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1753 microversion: 2.1 time: 0.163706 Aug 24 03:34:17.828103 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 242/488] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:17 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:18.849179 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-a6c422d9-41a4-4c42-832b-459a74be3d40 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:18.849739 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-a6c422d9-41a4-4c42-832b-459a74be3d40 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:18.856400 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a6c422d9-41a4-4c42-832b-459a74be3d40 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:18.856921 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a6c422d9-41a4-4c42-832b-459a74be3d40 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:18.857365 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a6c422d9-41a4-4c42-832b-459a74be3d40 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:18.858066 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a6c422d9-41a4-4c42-832b-459a74be3d40 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:18.858522 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a6c422d9-41a4-4c42-832b-459a74be3d40 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:18.858951 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a6c422d9-41a4-4c42-832b-459a74be3d40 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:19.002287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-a6c422d9-41a4-4c42-832b-459a74be3d40 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:19.010528 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-a6c422d9-41a4-4c42-832b-459a74be3d40 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1753 microversion: 2.1 time: 0.165664 Aug 24 03:34:19.011087 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 247/489] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:18 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:20.032739 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4946560d-2a36-4f09-bab9-f20d627d5162 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:20.033405 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-4946560d-2a36-4f09-bab9-f20d627d5162 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:20.039913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4946560d-2a36-4f09-bab9-f20d627d5162 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:20.040397 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4946560d-2a36-4f09-bab9-f20d627d5162 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:20.040860 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4946560d-2a36-4f09-bab9-f20d627d5162 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:20.041554 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4946560d-2a36-4f09-bab9-f20d627d5162 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:20.042004 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4946560d-2a36-4f09-bab9-f20d627d5162 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:20.042429 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4946560d-2a36-4f09-bab9-f20d627d5162 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:20.057067 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=100 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:20.184326 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4946560d-2a36-4f09-bab9-f20d627d5162 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:20.193127 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4946560d-2a36-4f09-bab9-f20d627d5162 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1753 microversion: 2.1 time: 0.165000 Aug 24 03:34:20.193699 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 243/490] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:20 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:20.457989 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-c1b3adff-747f-431e-880e-b3e8f3fd92b5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:20.460154 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-c1b3adff-747f-431e-880e-b3e8f3fd92b5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:20.466543 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c1b3adff-747f-431e-880e-b3e8f3fd92b5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:20.467029 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c1b3adff-747f-431e-880e-b3e8f3fd92b5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:20.467467 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c1b3adff-747f-431e-880e-b3e8f3fd92b5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:20.468159 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c1b3adff-747f-431e-880e-b3e8f3fd92b5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:20.468619 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c1b3adff-747f-431e-880e-b3e8f3fd92b5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:20.469144 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c1b3adff-747f-431e-880e-b3e8f3fd92b5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:20.501220 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-c1b3adff-747f-431e-880e-b3e8f3fd92b5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047141 Aug 24 03:34:20.501777 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 248/491] 10.222.0.81 () {58 vars in 1302 bytes} [Wed Aug 24 03:34:20 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:34:20.562393 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-548bbb90-da98-49b6-b5e2-7177b2d4914e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:20.564110 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-548bbb90-da98-49b6-b5e2-7177b2d4914e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:20.570012 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-548bbb90-da98-49b6-b5e2-7177b2d4914e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:20.570498 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-548bbb90-da98-49b6-b5e2-7177b2d4914e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:20.570933 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-548bbb90-da98-49b6-b5e2-7177b2d4914e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:20.571617 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-548bbb90-da98-49b6-b5e2-7177b2d4914e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:20.572069 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-548bbb90-da98-49b6-b5e2-7177b2d4914e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:20.572489 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-548bbb90-da98-49b6-b5e2-7177b2d4914e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:20.598154 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-548bbb90-da98-49b6-b5e2-7177b2d4914e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Going to try to terminate instance {{(pid=120708) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:34:20.673285 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-548bbb90-da98-49b6-b5e2-7177b2d4914e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "DELETE /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 204 len: 0 microversion: 2.1 time: 0.113556 Aug 24 03:34:20.674116 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 244/492] 10.222.0.81 () {58 vars in 1239 bytes} [Wed Aug 24 03:34:20 2022] DELETE /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:34:20.683768 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-875e4cfc-fe68-4165-bf7d-1da0b97911a4 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:20.684391 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-875e4cfc-fe68-4165-bf7d-1da0b97911a4 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:20.690523 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-875e4cfc-fe68-4165-bf7d-1da0b97911a4 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:20.691011 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-875e4cfc-fe68-4165-bf7d-1da0b97911a4 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:20.691451 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-875e4cfc-fe68-4165-bf7d-1da0b97911a4 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:20.692310 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-875e4cfc-fe68-4165-bf7d-1da0b97911a4 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:20.692793 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-875e4cfc-fe68-4165-bf7d-1da0b97911a4 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:20.693219 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-875e4cfc-fe68-4165-bf7d-1da0b97911a4 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:20.825206 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-875e4cfc-fe68-4165-bf7d-1da0b97911a4 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:20.833917 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-875e4cfc-fe68-4165-bf7d-1da0b97911a4 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1673 microversion: 2.1 time: 0.154981 Aug 24 03:34:20.834497 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 249/493] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:20 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:21.214428 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-93c95eff-2669-48ba-8f6e-94a94ba587c8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:21.215131 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-93c95eff-2669-48ba-8f6e-94a94ba587c8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:21.222146 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-93c95eff-2669-48ba-8f6e-94a94ba587c8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:21.222629 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-93c95eff-2669-48ba-8f6e-94a94ba587c8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:21.223070 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-93c95eff-2669-48ba-8f6e-94a94ba587c8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:21.224005 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-93c95eff-2669-48ba-8f6e-94a94ba587c8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:21.224456 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-93c95eff-2669-48ba-8f6e-94a94ba587c8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:21.224904 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-93c95eff-2669-48ba-8f6e-94a94ba587c8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:21.366049 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-93c95eff-2669-48ba-8f6e-94a94ba587c8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:21.374190 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-93c95eff-2669-48ba-8f6e-94a94ba587c8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1753 microversion: 2.1 time: 0.164039 Aug 24 03:34:21.374755 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 245/494] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:21 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:21.855675 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-8fcbfae5-5f02-44a4-b3c0-84cecd9cd31f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:21.856283 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-8fcbfae5-5f02-44a4-b3c0-84cecd9cd31f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:21.862744 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8fcbfae5-5f02-44a4-b3c0-84cecd9cd31f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:21.863222 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8fcbfae5-5f02-44a4-b3c0-84cecd9cd31f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:21.863657 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8fcbfae5-5f02-44a4-b3c0-84cecd9cd31f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:21.864342 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8fcbfae5-5f02-44a4-b3c0-84cecd9cd31f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:21.865795 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8fcbfae5-5f02-44a4-b3c0-84cecd9cd31f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:21.865795 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8fcbfae5-5f02-44a4-b3c0-84cecd9cd31f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:21.998423 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-8fcbfae5-5f02-44a4-b3c0-84cecd9cd31f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:22.006500 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-8fcbfae5-5f02-44a4-b3c0-84cecd9cd31f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1673 microversion: 2.1 time: 0.154738 Aug 24 03:34:22.007064 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 250/495] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:21 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:22.395448 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d66c289f-0c04-477d-932b-cf944470a695 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:22.396061 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d66c289f-0c04-477d-932b-cf944470a695 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:22.402610 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d66c289f-0c04-477d-932b-cf944470a695 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:22.403096 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d66c289f-0c04-477d-932b-cf944470a695 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:22.403561 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d66c289f-0c04-477d-932b-cf944470a695 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:22.404243 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d66c289f-0c04-477d-932b-cf944470a695 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:22.404696 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d66c289f-0c04-477d-932b-cf944470a695 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:22.405146 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d66c289f-0c04-477d-932b-cf944470a695 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:22.549133 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d66c289f-0c04-477d-932b-cf944470a695 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:22.557584 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d66c289f-0c04-477d-932b-cf944470a695 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1753 microversion: 2.1 time: 0.166116 Aug 24 03:34:22.558430 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 246/496] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:22 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:23.028508 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-626ea622-827a-4c65-b580-3ba3db3c3b5e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:23.029155 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-626ea622-827a-4c65-b580-3ba3db3c3b5e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:23.036106 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-626ea622-827a-4c65-b580-3ba3db3c3b5e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:23.036600 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-626ea622-827a-4c65-b580-3ba3db3c3b5e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:23.037076 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-626ea622-827a-4c65-b580-3ba3db3c3b5e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:23.037778 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-626ea622-827a-4c65-b580-3ba3db3c3b5e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:23.038239 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-626ea622-827a-4c65-b580-3ba3db3c3b5e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:23.038666 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-626ea622-827a-4c65-b580-3ba3db3c3b5e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:23.167570 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-626ea622-827a-4c65-b580-3ba3db3c3b5e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:23.175541 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-626ea622-827a-4c65-b580-3ba3db3c3b5e tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1673 microversion: 2.1 time: 0.150991 Aug 24 03:34:23.176109 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 251/497] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:23 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:23.580491 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-32bd343e-5bbd-42f6-a09c-b108c5e7fc87 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:23.581261 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-32bd343e-5bbd-42f6-a09c-b108c5e7fc87 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:23.589957 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-32bd343e-5bbd-42f6-a09c-b108c5e7fc87 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:23.590448 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-32bd343e-5bbd-42f6-a09c-b108c5e7fc87 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:23.590884 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-32bd343e-5bbd-42f6-a09c-b108c5e7fc87 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:23.591584 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-32bd343e-5bbd-42f6-a09c-b108c5e7fc87 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:23.592038 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-32bd343e-5bbd-42f6-a09c-b108c5e7fc87 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:23.592545 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-32bd343e-5bbd-42f6-a09c-b108c5e7fc87 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:23.757179 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-32bd343e-5bbd-42f6-a09c-b108c5e7fc87 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:23.765467 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-32bd343e-5bbd-42f6-a09c-b108c5e7fc87 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1753 microversion: 2.1 time: 0.189722 Aug 24 03:34:23.766635 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 247/498] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:23 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1753 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:23.938177 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-af463e5a-3a12-416e-a10b-f9bc27026743 req-a0a84046-7f39-4b05-bddb-b456853a32e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b97b3d6-5022-46c8-a189-fed177d028c8", "name": "network-vif-deleted", "tag": "22bcdf61-5bce-471a-ac6d-924789d218c0"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:23.950016 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-af463e5a-3a12-416e-a10b-f9bc27026743 req-a0a84046-7f39-4b05-bddb-b456853a32e3 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:23.950580 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-af463e5a-3a12-416e-a10b-f9bc27026743 req-a0a84046-7f39-4b05-bddb-b456853a32e3 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:23.951024 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-af463e5a-3a12-416e-a10b-f9bc27026743 req-a0a84046-7f39-4b05-bddb-b456853a32e3 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:23.964034 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-af463e5a-3a12-416e-a10b-f9bc27026743 req-a0a84046-7f39-4b05-bddb-b456853a32e3 service nova] Creating event network-vif-deleted:22bcdf61-5bce-471a-ac6d-924789d218c0 for instance 9b97b3d6-5022-46c8-a189-fed177d028c8 on hv-cinder-85426 Aug 24 03:34:23.969841 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-af463e5a-3a12-416e-a10b-f9bc27026743 req-a0a84046-7f39-4b05-bddb-b456853a32e3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035582 Aug 24 03:34:23.970827 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 252/499] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:24.197255 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-6f5990fa-8f77-489c-a804-212215028281 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:24.198005 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-6f5990fa-8f77-489c-a804-212215028281 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:24.204068 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6f5990fa-8f77-489c-a804-212215028281 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:24.204556 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6f5990fa-8f77-489c-a804-212215028281 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:24.205013 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6f5990fa-8f77-489c-a804-212215028281 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:24.205736 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6f5990fa-8f77-489c-a804-212215028281 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:24.206191 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6f5990fa-8f77-489c-a804-212215028281 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:24.206608 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6f5990fa-8f77-489c-a804-212215028281 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:24.266997 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6f5990fa-8f77-489c-a804-212215028281 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:24.268221 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6f5990fa-8f77-489c-a804-212215028281 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:24.269200 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6f5990fa-8f77-489c-a804-212215028281 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:24.270559 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.objects.instance [None req-6f5990fa-8f77-489c-a804-212215028281 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lazy-loading 'fault' on Instance uuid 9b97b3d6-5022-46c8-a189-fed177d028c8 {{(pid=120708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:34:24.325600 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-6f5990fa-8f77-489c-a804-212215028281 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:24.333982 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-6f5990fa-8f77-489c-a804-212215028281 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 200 len: 1326 microversion: 2.1 time: 0.140716 Aug 24 03:34:24.334562 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 248/500] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:24 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 1326 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:24.788894 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-ce948ab4-4a1a-43b9-929c-728307bf1a43 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:24.790959 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-ce948ab4-4a1a-43b9-929c-728307bf1a43 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:24.797721 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ce948ab4-4a1a-43b9-929c-728307bf1a43 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:24.798243 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ce948ab4-4a1a-43b9-929c-728307bf1a43 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:24.798762 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ce948ab4-4a1a-43b9-929c-728307bf1a43 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:24.799529 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ce948ab4-4a1a-43b9-929c-728307bf1a43 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:24.799989 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ce948ab4-4a1a-43b9-929c-728307bf1a43 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:24.800425 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ce948ab4-4a1a-43b9-929c-728307bf1a43 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:24.958011 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-ce948ab4-4a1a-43b9-929c-728307bf1a43 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:24.966642 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-ce948ab4-4a1a-43b9-929c-728307bf1a43 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1756 microversion: 2.1 time: 0.182556 Aug 24 03:34:24.967214 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 253/501] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:24 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:25.357257 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d53555cc-7490-4697-b8e1-d4514aeee072 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:25.357867 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d53555cc-7490-4697-b8e1-d4514aeee072 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:25.365793 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d53555cc-7490-4697-b8e1-d4514aeee072 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:25.366277 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d53555cc-7490-4697-b8e1-d4514aeee072 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:25.366717 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d53555cc-7490-4697-b8e1-d4514aeee072 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:25.367413 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d53555cc-7490-4697-b8e1-d4514aeee072 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:25.367867 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d53555cc-7490-4697-b8e1-d4514aeee072 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:25.368325 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d53555cc-7490-4697-b8e1-d4514aeee072 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:25.382756 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-d53555cc-7490-4697-b8e1-d4514aeee072 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] HTTP exception thrown: Instance 9b97b3d6-5022-46c8-a189-fed177d028c8 could not be found. Aug 24 03:34:25.384393 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d53555cc-7490-4697-b8e1-d4514aeee072 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Request method failure captured: Aug 24 03:34:25.384393 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 HTTP/1.1 Aug 24 03:34:25.384393 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 24 03:34:25.384393 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 24 03:34:25.384393 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Connection: close Aug 24 03:34:25.384393 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 24 03:34:25.384393 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 24 03:34:25.384393 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Host: 10.222.0.81 Aug 24 03:34:25.384393 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 24 03:34:25.384393 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.11 Aug 24 03:34:25.384393 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjBZtP_wpwR9Y3bAcDYGBOT0mwVsByRvMetP-LFXmeiOuOHDaCm33H67I99DE_xaqBHlQVAXqo42-hQvceoTyzqUaUrREzwFCjB5uheciPzS-0oo6Dt1FFFg2gNgREWRC2xcQUJRjSVnFD9346HbvgMLQDPZu_rRgzBO_s4TcXYCjCPTI Aug 24 03:34:25.384393 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 24 03:34:25.384393 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 24 03:34:25.384393 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 24 03:34:25.384393 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 24 03:34:25.384393 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 24 03:34:25.384393 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 24 03:34:25.384393 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Id: 6a1e9994c1c045c892059d5b80578ba7 Aug 24 03:34:25.384393 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-AttachVolumeTestJSON-1807952205 Aug 24 03:34:25.384393 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 24 03:34:25.384393 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 24 03:34:25.385943 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6a1e9994c1c045c892059d5b80578ba7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6a1e9994c1c045c892059d5b80578ba7", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6a1e9994c1c045c892059d5b80578ba7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6a1e9994c1c045c892059d5b80578ba7"}]}] Aug 24 03:34:25.385943 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-AttachVolumeTestJSON-1807952205 Aug 24 03:34:25.385943 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 6a1e9994c1c045c892059d5b80578ba7 Aug 24 03:34:25.385943 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1807952205 Aug 24 03:34:25.385943 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User: tempest-AttachVolumeTestJSON-1807952205-project Aug 24 03:34:25.385943 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 24 03:34:25.385943 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 24 03:34:25.385943 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Id: 66900b813b934514a7920ba975a05ec5 Aug 24 03:34:25.385943 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-AttachVolumeTestJSON-1807952205-project Aug 24 03:34:25.385943 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: method: > Aug 24 03:34:25.385943 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: exception: Instance 9b97b3d6-5022-46c8-a189-fed177d028c8 could not be found. Aug 24 03:34:25.385943 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: action_args: {'id': '9b97b3d6-5022-46c8-a189-fed177d028c8'} Aug 24 03:34:25.386771 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:34:25.386771 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:25.386771 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:34:25.386771 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:34:25.386771 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:34:25.386771 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:34:25.386771 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:34:25.386771 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:34:25.386771 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:34:25.386771 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:34:25.386771 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b97b3d6-5022-46c8-a189-fed177d028c8 could not be found. Aug 24 03:34:25.386771 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:34:25.386771 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:34:25.386771 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:34:25.386771 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:25.386771 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:34:25.386771 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:34:25.386771 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:34:25.386771 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:34:25.386771 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:34:25.387914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:34:25.387914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:34:25.387914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:34:25.387914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:34:25.387914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:34:25.387914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:34:25.387914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:34:25.387914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b97b3d6-5022-46c8-a189-fed177d028c8 could not be found. Aug 24 03:34:25.387914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:34:25.387914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:34:25.387914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:34:25.387914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:25.387914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:34:25.387914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:34:25.387914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:34:25.387914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:34:25.387914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b97b3d6-5022-46c8-a189-fed177d028c8 could not be found. Aug 24 03:34:25.387914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:34:25.389065 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d53555cc-7490-4697-b8e1-d4514aeee072 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Returning 404 to user: Instance 9b97b3d6-5022-46c8-a189-fed177d028c8 could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:34:25.389065 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d53555cc-7490-4697-b8e1-d4514aeee072 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 404 len: 111 microversion: 2.1 time: 0.032779 Aug 24 03:34:25.389065 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 249/502] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:25 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:34:25.394917 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-89467d4e-d457-4e90-bcb9-303e3c172cf6 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '.version_select at 0x7f942f4703a0>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:25.414138 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-89467d4e-d457-4e90-bcb9-303e3c172cf6 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-388470747" status: 202 len: 0 microversion: 2.1 time: 0.023067 Aug 24 03:34:25.414689 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 254/503] 10.222.0.81 () {58 vars in 1218 bytes} [Wed Aug 24 03:34:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-388470747 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:34:26.076460 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-3d09cb67-cce7-4eb4-b8b0-0c26dfe088d4 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Action: 'create', calling method: .version_select at 0x7f942f2229d0>, body: {"keypair": {"name": "tempest-keypair-982709269", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgwpV5RRSom/NcLOXDlgWf0MJMN++BMZrsRXj+ByW+BC4qVEgN3MamPnvahUCIz2U7yCb95EnDZbLYOoMoD5I/iFhOrPAwfs/isw/daGNFqYaE9bG6S29DRyxw2Z4AAIw=="}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:26.091875 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-3d09cb67-cce7-4eb4-b8b0-0c26dfe088d4 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Getting quotas for project 6a1e9994c1c045c892059d5b80578ba7. Resources: {'key_pairs'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:34:26.095802 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-3d09cb67-cce7-4eb4-b8b0-0c26dfe088d4 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Getting quotas for user 66900b813b934514a7920ba975a05ec5 and project 6a1e9994c1c045c892059d5b80578ba7. Resources: {'key_pairs'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:34:26.119324 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-3d09cb67-cce7-4eb4-b8b0-0c26dfe088d4 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046794 Aug 24 03:34:26.119913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 250/504] 10.222.0.81 () {60 vars in 1159 bytes} [Wed Aug 24 03:34:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:27.407141 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-bca01a65-821b-41a7-9cbf-d91adceec0c6 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-465018377", "imageRef": "b7a40f0c-20c2-44cd-8b0e-f6e73a007d3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e243b8d3-7de2-4711-8726-42cf22c7a222"}], "security_groups": [{"name": "tempest-securitygroup--658822070"}], "key_name": "tempest-keypair-982709269", "user_data": "}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:27.512419 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.network.neutron [None req-bca01a65-821b-41a7-9cbf-d91adceec0c6 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] validate_networks() for [('e243b8d3-7de2-4711-8726-42cf22c7a222', None, None, None, None, None)] {{(pid=120709) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:34:27.894332 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-bca01a65-821b-41a7-9cbf-d91adceec0c6 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Flavor limits 0:0:0 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:34:27.894759 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-bca01a65-821b-41a7-9cbf-d91adceec0c6 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Image limits 0:0:0 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:34:27.895242 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-bca01a65-821b-41a7-9cbf-d91adceec0c6 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Flavor pref 0:0:0 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:34:27.895654 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-bca01a65-821b-41a7-9cbf-d91adceec0c6 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Image pref 0:0:0 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:34:27.896252 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-bca01a65-821b-41a7-9cbf-d91adceec0c6 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:34:27.905211 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bca01a65-821b-41a7-9cbf-d91adceec0c6 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:27.905782 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bca01a65-821b-41a7-9cbf-d91adceec0c6 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:27.906234 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bca01a65-821b-41a7-9cbf-d91adceec0c6 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:27.906985 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bca01a65-821b-41a7-9cbf-d91adceec0c6 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:27.907421 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bca01a65-821b-41a7-9cbf-d91adceec0c6 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:27.907850 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bca01a65-821b-41a7-9cbf-d91adceec0c6 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:27.925911 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.quota [None req-bca01a65-821b-41a7-9cbf-d91adceec0c6 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Getting quotas for project 6a1e9994c1c045c892059d5b80578ba7. Resources: {'ram', 'instances', 'cores'} {{(pid=120709) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:34:27.930586 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.quota [None req-bca01a65-821b-41a7-9cbf-d91adceec0c6 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Getting quotas for user 66900b813b934514a7920ba975a05ec5 and project 6a1e9994c1c045c892059d5b80578ba7. Resources: {'ram', 'instances', 'cores'} {{(pid=120709) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:34:27.943367 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-bca01a65-821b-41a7-9cbf-d91adceec0c6 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Going to run 1 instances... {{(pid=120709) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:34:27.945689 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-bca01a65-821b-41a7-9cbf-d91adceec0c6 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: add1236d-0d50-4a63-8e61-9046f9d8b42d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b7a40f0c-20c2-44cd-8b0e-f6e73a007d3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120709) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:34:27.996249 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-bca01a65-821b-41a7-9cbf-d91adceec0c6 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.594137 Aug 24 03:34:27.996935 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 255/505] 10.222.0.81 () {60 vars in 1147 bytes} [Wed Aug 24 03:34:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:34:28.009397 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4ebdb6fb-7c58-4378-a086-8bfdf1f8d942 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:28.010657 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-4ebdb6fb-7c58-4378-a086-8bfdf1f8d942 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: add1236d-0d50-4a63-8e61-9046f9d8b42d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:28.013255 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:28.068045 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4ebdb6fb-7c58-4378-a086-8bfdf1f8d942 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:28.074916 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4ebdb6fb-7c58-4378-a086-8bfdf1f8d942 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d" status: 200 len: 1236 microversion: 2.1 time: 0.069484 Aug 24 03:34:28.075490 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 251/506] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:28 2022] GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d => generated 1236 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:29.097147 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-406f66d8-4cb6-49fd-9fbe-82f69a38c932 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:29.098061 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-406f66d8-4cb6-49fd-9fbe-82f69a38c932 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: add1236d-0d50-4a63-8e61-9046f9d8b42d] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:29.104047 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-406f66d8-4cb6-49fd-9fbe-82f69a38c932 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:29.104539 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-406f66d8-4cb6-49fd-9fbe-82f69a38c932 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:29.105015 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-406f66d8-4cb6-49fd-9fbe-82f69a38c932 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:29.105718 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-406f66d8-4cb6-49fd-9fbe-82f69a38c932 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:29.106176 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-406f66d8-4cb6-49fd-9fbe-82f69a38c932 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:29.106611 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-406f66d8-4cb6-49fd-9fbe-82f69a38c932 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:29.174784 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-406f66d8-4cb6-49fd-9fbe-82f69a38c932 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:29.182420 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-406f66d8-4cb6-49fd-9fbe-82f69a38c932 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d" status: 200 len: 1296 microversion: 2.1 time: 0.089776 Aug 24 03:34:29.182978 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 256/507] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:29 2022] GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d => generated 1296 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:30.203729 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-8ad9f699-128b-4d52-b5dc-1c54e5ead658 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:30.204498 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-8ad9f699-128b-4d52-b5dc-1c54e5ead658 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: add1236d-0d50-4a63-8e61-9046f9d8b42d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:30.211283 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8ad9f699-128b-4d52-b5dc-1c54e5ead658 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:30.211776 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8ad9f699-128b-4d52-b5dc-1c54e5ead658 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:30.212216 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8ad9f699-128b-4d52-b5dc-1c54e5ead658 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:30.212986 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8ad9f699-128b-4d52-b5dc-1c54e5ead658 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:30.213605 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8ad9f699-128b-4d52-b5dc-1c54e5ead658 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:30.214031 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8ad9f699-128b-4d52-b5dc-1c54e5ead658 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:30.344961 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-8ad9f699-128b-4d52-b5dc-1c54e5ead658 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:30.352884 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-8ad9f699-128b-4d52-b5dc-1c54e5ead658 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d" status: 200 len: 1361 microversion: 2.1 time: 0.153236 Aug 24 03:34:30.353461 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 252/508] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:30 2022] GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:30.523166 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-c2c19366-99da-4a78-a52d-851b33a23768 req-12fce22b-f3e2-4f02-bc7b-76e83553c1b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "add1236d-0d50-4a63-8e61-9046f9d8b42d", "tag": "5619faf8-463d-4ee6-862c-26779d2f1963"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:30.533840 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-c2c19366-99da-4a78-a52d-851b33a23768 req-12fce22b-f3e2-4f02-bc7b-76e83553c1b2 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:30.534447 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-c2c19366-99da-4a78-a52d-851b33a23768 req-12fce22b-f3e2-4f02-bc7b-76e83553c1b2 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:30.535036 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-c2c19366-99da-4a78-a52d-851b33a23768 req-12fce22b-f3e2-4f02-bc7b-76e83553c1b2 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:30.547012 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-c2c19366-99da-4a78-a52d-851b33a23768 req-12fce22b-f3e2-4f02-bc7b-76e83553c1b2 service nova] Creating event network-changed:5619faf8-463d-4ee6-862c-26779d2f1963 for instance add1236d-0d50-4a63-8e61-9046f9d8b42d on hv-cinder-85426 Aug 24 03:34:30.551693 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-c2c19366-99da-4a78-a52d-851b33a23768 req-12fce22b-f3e2-4f02-bc7b-76e83553c1b2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032360 Aug 24 03:34:30.552285 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 257/509] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:31.375126 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b3768c9a-7801-4139-b13e-496c01140160 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:31.375732 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-b3768c9a-7801-4139-b13e-496c01140160 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: add1236d-0d50-4a63-8e61-9046f9d8b42d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:31.382137 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b3768c9a-7801-4139-b13e-496c01140160 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:31.382616 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b3768c9a-7801-4139-b13e-496c01140160 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:31.383046 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b3768c9a-7801-4139-b13e-496c01140160 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:31.383758 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b3768c9a-7801-4139-b13e-496c01140160 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:31.384209 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b3768c9a-7801-4139-b13e-496c01140160 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:31.384629 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b3768c9a-7801-4139-b13e-496c01140160 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:31.524005 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-b3768c9a-7801-4139-b13e-496c01140160 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:31.532395 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-b3768c9a-7801-4139-b13e-496c01140160 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d" status: 200 len: 1361 microversion: 2.1 time: 0.161801 Aug 24 03:34:31.533028 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 253/510] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:31 2022] GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:32.554576 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-4fb9da2d-97df-4d26-b1b5-b1efd5b2285f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:32.555304 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-4fb9da2d-97df-4d26-b1b5-b1efd5b2285f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: add1236d-0d50-4a63-8e61-9046f9d8b42d] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:32.561430 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4fb9da2d-97df-4d26-b1b5-b1efd5b2285f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:32.562378 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4fb9da2d-97df-4d26-b1b5-b1efd5b2285f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:32.562820 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4fb9da2d-97df-4d26-b1b5-b1efd5b2285f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:32.563512 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4fb9da2d-97df-4d26-b1b5-b1efd5b2285f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:32.563969 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4fb9da2d-97df-4d26-b1b5-b1efd5b2285f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:32.564391 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4fb9da2d-97df-4d26-b1b5-b1efd5b2285f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:32.697196 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-4fb9da2d-97df-4d26-b1b5-b1efd5b2285f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:32.705481 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-4fb9da2d-97df-4d26-b1b5-b1efd5b2285f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d" status: 200 len: 1361 microversion: 2.1 time: 0.155732 Aug 24 03:34:32.706041 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 258/511] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:32 2022] GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:33.727534 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ceca87a7-5e3a-4d2d-bc18-05848b568127 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:33.728147 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ceca87a7-5e3a-4d2d-bc18-05848b568127 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: add1236d-0d50-4a63-8e61-9046f9d8b42d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:33.735458 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ceca87a7-5e3a-4d2d-bc18-05848b568127 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:33.735946 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ceca87a7-5e3a-4d2d-bc18-05848b568127 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:33.736396 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ceca87a7-5e3a-4d2d-bc18-05848b568127 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:33.737120 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ceca87a7-5e3a-4d2d-bc18-05848b568127 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:33.737577 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ceca87a7-5e3a-4d2d-bc18-05848b568127 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:33.738001 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ceca87a7-5e3a-4d2d-bc18-05848b568127 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:33.871746 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ceca87a7-5e3a-4d2d-bc18-05848b568127 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:33.880172 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ceca87a7-5e3a-4d2d-bc18-05848b568127 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d" status: 200 len: 1361 microversion: 2.1 time: 0.156729 Aug 24 03:34:33.880736 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 254/512] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:33 2022] GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:34.901825 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-da67b22f-5a8a-4feb-90aa-6a4d737c3c1c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:34.902416 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-da67b22f-5a8a-4feb-90aa-6a4d737c3c1c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: add1236d-0d50-4a63-8e61-9046f9d8b42d] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:34.909697 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-da67b22f-5a8a-4feb-90aa-6a4d737c3c1c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:34.910247 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-da67b22f-5a8a-4feb-90aa-6a4d737c3c1c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:34.910689 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-da67b22f-5a8a-4feb-90aa-6a4d737c3c1c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:34.911383 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-da67b22f-5a8a-4feb-90aa-6a4d737c3c1c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:34.911837 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-da67b22f-5a8a-4feb-90aa-6a4d737c3c1c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:34.912432 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-da67b22f-5a8a-4feb-90aa-6a4d737c3c1c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:35.040481 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-da67b22f-5a8a-4feb-90aa-6a4d737c3c1c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:35.048259 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-da67b22f-5a8a-4feb-90aa-6a4d737c3c1c tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d" status: 200 len: 1361 microversion: 2.1 time: 0.150279 Aug 24 03:34:35.048830 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 259/513] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:34 2022] GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:35.741522 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-ae3c112b-6843-4da0-be60-b855997a3c13 req-bbc9036c-3032-46b7-9cc6-cdd3e3be72b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "add1236d-0d50-4a63-8e61-9046f9d8b42d", "name": "network-vif-plugged", "status": "completed", "tag": "5619faf8-463d-4ee6-862c-26779d2f1963"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:35.752799 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-ae3c112b-6843-4da0-be60-b855997a3c13 req-bbc9036c-3032-46b7-9cc6-cdd3e3be72b0 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:35.753285 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-ae3c112b-6843-4da0-be60-b855997a3c13 req-bbc9036c-3032-46b7-9cc6-cdd3e3be72b0 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:35.753715 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-ae3c112b-6843-4da0-be60-b855997a3c13 req-bbc9036c-3032-46b7-9cc6-cdd3e3be72b0 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:35.765063 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-ae3c112b-6843-4da0-be60-b855997a3c13 req-bbc9036c-3032-46b7-9cc6-cdd3e3be72b0 service nova] Creating event network-vif-plugged:5619faf8-463d-4ee6-862c-26779d2f1963 for instance add1236d-0d50-4a63-8e61-9046f9d8b42d on hv-cinder-85426 Aug 24 03:34:35.770207 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-ae3c112b-6843-4da0-be60-b855997a3c13 req-bbc9036c-3032-46b7-9cc6-cdd3e3be72b0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032461 Aug 24 03:34:35.770775 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 255/514] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:36.068745 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-6e4a3975-f9a4-4a96-b551-e2b1ef1596fa tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:36.069439 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-6e4a3975-f9a4-4a96-b551-e2b1ef1596fa tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: add1236d-0d50-4a63-8e61-9046f9d8b42d] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:36.075779 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6e4a3975-f9a4-4a96-b551-e2b1ef1596fa tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:36.076254 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6e4a3975-f9a4-4a96-b551-e2b1ef1596fa tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:36.076691 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6e4a3975-f9a4-4a96-b551-e2b1ef1596fa tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:36.077430 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6e4a3975-f9a4-4a96-b551-e2b1ef1596fa tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:36.077885 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6e4a3975-f9a4-4a96-b551-e2b1ef1596fa tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:36.078308 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6e4a3975-f9a4-4a96-b551-e2b1ef1596fa tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:36.094141 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell1:SELECT=100 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:36.205574 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-6e4a3975-f9a4-4a96-b551-e2b1ef1596fa tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:36.213104 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-6e4a3975-f9a4-4a96-b551-e2b1ef1596fa tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d" status: 200 len: 1361 microversion: 2.1 time: 0.148167 Aug 24 03:34:36.213658 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 260/515] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:36 2022] GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d => generated 1361 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:37.235379 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-fe52ecb7-196b-4b56-9fdb-9a3165fa4bab tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:37.235997 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-fe52ecb7-196b-4b56-9fdb-9a3165fa4bab tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: add1236d-0d50-4a63-8e61-9046f9d8b42d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:37.242219 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fe52ecb7-196b-4b56-9fdb-9a3165fa4bab tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:37.242707 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fe52ecb7-196b-4b56-9fdb-9a3165fa4bab tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:37.243148 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fe52ecb7-196b-4b56-9fdb-9a3165fa4bab tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:37.243841 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fe52ecb7-196b-4b56-9fdb-9a3165fa4bab tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:37.244295 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fe52ecb7-196b-4b56-9fdb-9a3165fa4bab tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:37.244721 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fe52ecb7-196b-4b56-9fdb-9a3165fa4bab tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:37.377490 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-fe52ecb7-196b-4b56-9fdb-9a3165fa4bab tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:37.385655 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-fe52ecb7-196b-4b56-9fdb-9a3165fa4bab tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d" status: 200 len: 1361 microversion: 2.1 time: 0.155491 Aug 24 03:34:37.386221 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 256/516] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:37 2022] GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:38.406803 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-c8a8b698-b316-4b67-9bed-dbaeafe61343 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:38.407431 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-c8a8b698-b316-4b67-9bed-dbaeafe61343 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: add1236d-0d50-4a63-8e61-9046f9d8b42d] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:38.409911 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell0:SELECT=2 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:38.410634 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell0:SELECT=6 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:38.417439 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c8a8b698-b316-4b67-9bed-dbaeafe61343 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:38.417922 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c8a8b698-b316-4b67-9bed-dbaeafe61343 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:38.418354 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c8a8b698-b316-4b67-9bed-dbaeafe61343 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:38.419043 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c8a8b698-b316-4b67-9bed-dbaeafe61343 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:38.419498 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c8a8b698-b316-4b67-9bed-dbaeafe61343 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:38.419921 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c8a8b698-b316-4b67-9bed-dbaeafe61343 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:38.557181 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-c8a8b698-b316-4b67-9bed-dbaeafe61343 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:38.565477 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-c8a8b698-b316-4b67-9bed-dbaeafe61343 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d" status: 200 len: 1547 microversion: 2.1 time: 0.162741 Aug 24 03:34:38.566039 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 261/517] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:38 2022] GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d => generated 1547 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:38.587378 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7e6975e8-cb19-4cdb-9dd1-27faf83ce583 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:38.587922 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-7e6975e8-cb19-4cdb-9dd1-27faf83ce583 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: add1236d-0d50-4a63-8e61-9046f9d8b42d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:38.589940 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=6 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:38.596330 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7e6975e8-cb19-4cdb-9dd1-27faf83ce583 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:38.597221 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7e6975e8-cb19-4cdb-9dd1-27faf83ce583 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:38.597704 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7e6975e8-cb19-4cdb-9dd1-27faf83ce583 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:38.598436 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7e6975e8-cb19-4cdb-9dd1-27faf83ce583 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:38.598929 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7e6975e8-cb19-4cdb-9dd1-27faf83ce583 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:38.599401 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7e6975e8-cb19-4cdb-9dd1-27faf83ce583 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:38.675618 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-7e6975e8-cb19-4cdb-9dd1-27faf83ce583 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092208 Aug 24 03:34:38.676206 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 257/518] 10.222.0.81 () {58 vars in 1275 bytes} [Wed Aug 24 03:34:38 2022] GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:39.809569 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-5e9f8135-bbb9-4b79-a541-071c5e6c8883 req-37da906e-be3f-4db0-82c8-4b9848a85666 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "add1236d-0d50-4a63-8e61-9046f9d8b42d", "tag": "5619faf8-463d-4ee6-862c-26779d2f1963"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:39.819571 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-5e9f8135-bbb9-4b79-a541-071c5e6c8883 req-37da906e-be3f-4db0-82c8-4b9848a85666 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:39.820055 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-5e9f8135-bbb9-4b79-a541-071c5e6c8883 req-37da906e-be3f-4db0-82c8-4b9848a85666 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:39.820514 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-5e9f8135-bbb9-4b79-a541-071c5e6c8883 req-37da906e-be3f-4db0-82c8-4b9848a85666 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:39.831802 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-5e9f8135-bbb9-4b79-a541-071c5e6c8883 req-37da906e-be3f-4db0-82c8-4b9848a85666 service nova] Creating event network-changed:5619faf8-463d-4ee6-862c-26779d2f1963 for instance add1236d-0d50-4a63-8e61-9046f9d8b42d on hv-cinder-85426 Aug 24 03:34:39.836581 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-5e9f8135-bbb9-4b79-a541-071c5e6c8883 req-37da906e-be3f-4db0-82c8-4b9848a85666 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030708 Aug 24 03:34:39.837391 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 262/519] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:50.912596 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=15 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:50.913528 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:50.917883 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-6570c3c0-ed30-4d0c-9b5c-d40bead4fea0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:50.918376 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-6570c3c0-ed30-4d0c-9b5c-d40bead4fea0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:50.926875 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6570c3c0-ed30-4d0c-9b5c-d40bead4fea0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:50.927363 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6570c3c0-ed30-4d0c-9b5c-d40bead4fea0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:50.927801 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6570c3c0-ed30-4d0c-9b5c-d40bead4fea0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:50.928484 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6570c3c0-ed30-4d0c-9b5c-d40bead4fea0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:50.928968 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6570c3c0-ed30-4d0c-9b5c-d40bead4fea0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:50.929390 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6570c3c0-ed30-4d0c-9b5c-d40bead4fea0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:51.013519 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.objects.instance [None req-6570c3c0-ed30-4d0c-9b5c-d40bead4fea0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lazy-loading 'services' on Instance uuid 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 {{(pid=120708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:34:51.085762 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-6570c3c0-ed30-4d0c-9b5c-d40bead4fea0 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "DELETE /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280/os-volume_attachments/55ea0a6f-9c4d-4d85-86ab-0b3492bd1cbc" status: 202 len: 0 microversion: 2.1 time: 0.174162 Aug 24 03:34:51.086389 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 258/520] 10.222.0.81 () {58 vars in 1416 bytes} [Wed Aug 24 03:34:50 2022] DELETE /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280/os-volume_attachments/55ea0a6f-9c4d-4d85-86ab-0b3492bd1cbc => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:34:51.093088 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:51.094317 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell1:SELECT=11 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:51.098904 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-970f13e6-0add-4bc3-a27b-13a568b9df15 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:51.101181 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-970f13e6-0add-4bc3-a27b-13a568b9df15 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:51.109528 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-970f13e6-0add-4bc3-a27b-13a568b9df15 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:51.110113 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-970f13e6-0add-4bc3-a27b-13a568b9df15 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:51.110562 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-970f13e6-0add-4bc3-a27b-13a568b9df15 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:51.111271 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-970f13e6-0add-4bc3-a27b-13a568b9df15 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:51.111725 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-970f13e6-0add-4bc3-a27b-13a568b9df15 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:51.112155 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-970f13e6-0add-4bc3-a27b-13a568b9df15 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:51.141778 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-970f13e6-0add-4bc3-a27b-13a568b9df15 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050744 Aug 24 03:34:51.142551 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 263/521] 10.222.0.81 () {58 vars in 1302 bytes} [Wed Aug 24 03:34:51 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:34:52.156868 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0c3c9d70-92ac-4843-8357-26a23362b4aa tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:52.159414 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0c3c9d70-92ac-4843-8357-26a23362b4aa tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:52.168946 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0c3c9d70-92ac-4843-8357-26a23362b4aa tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:52.169972 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0c3c9d70-92ac-4843-8357-26a23362b4aa tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:52.170417 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0c3c9d70-92ac-4843-8357-26a23362b4aa tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:52.171120 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0c3c9d70-92ac-4843-8357-26a23362b4aa tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:52.171570 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0c3c9d70-92ac-4843-8357-26a23362b4aa tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:52.172206 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0c3c9d70-92ac-4843-8357-26a23362b4aa tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:52.213361 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0c3c9d70-92ac-4843-8357-26a23362b4aa tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062678 Aug 24 03:34:52.213936 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 259/522] 10.222.0.81 () {58 vars in 1302 bytes} [Wed Aug 24 03:34:52 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:53.227670 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-4d057cb2-31ce-4ce7-b2ce-35a2e32a6a0d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:53.229737 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-4d057cb2-31ce-4ce7-b2ce-35a2e32a6a0d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:53.236218 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4d057cb2-31ce-4ce7-b2ce-35a2e32a6a0d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:53.236719 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4d057cb2-31ce-4ce7-b2ce-35a2e32a6a0d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:53.237189 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4d057cb2-31ce-4ce7-b2ce-35a2e32a6a0d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:53.237896 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4d057cb2-31ce-4ce7-b2ce-35a2e32a6a0d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:53.238373 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4d057cb2-31ce-4ce7-b2ce-35a2e32a6a0d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:53.238794 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4d057cb2-31ce-4ce7-b2ce-35a2e32a6a0d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:53.267516 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-4d057cb2-31ce-4ce7-b2ce-35a2e32a6a0d tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043783 Aug 24 03:34:53.268062 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 264/523] 10.222.0.81 () {58 vars in 1302 bytes} [Wed Aug 24 03:34:53 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:34:53.284015 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a97851a9-28d6-4476-aaad-0613bef0a690 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:53.284536 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a97851a9-28d6-4476-aaad-0613bef0a690 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:53.290799 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a97851a9-28d6-4476-aaad-0613bef0a690 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:53.291284 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a97851a9-28d6-4476-aaad-0613bef0a690 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:53.291726 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a97851a9-28d6-4476-aaad-0613bef0a690 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:53.292416 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a97851a9-28d6-4476-aaad-0613bef0a690 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:53.292896 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a97851a9-28d6-4476-aaad-0613bef0a690 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:53.293320 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a97851a9-28d6-4476-aaad-0613bef0a690 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:53.323052 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a97851a9-28d6-4476-aaad-0613bef0a690 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040/os-volume_attachments/7b7dc90a-d27d-4673-8c6f-161c801916b4" status: 200 len: 194 microversion: 2.20 time: 0.043111 Aug 24 03:34:53.323630 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 260/524] 10.222.0.81 () {60 vars in 1454 bytes} [Wed Aug 24 03:34:53 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040/os-volume_attachments/7b7dc90a-d27d-4673-8c6f-161c801916b4 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:34:53.359269 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-71ed28af-6344-4c5c-b751-08445562c173 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:53.360028 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-71ed28af-6344-4c5c-b751-08445562c173 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:53.366417 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-71ed28af-6344-4c5c-b751-08445562c173 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:53.366910 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-71ed28af-6344-4c5c-b751-08445562c173 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:53.367350 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-71ed28af-6344-4c5c-b751-08445562c173 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:53.368037 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-71ed28af-6344-4c5c-b751-08445562c173 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:53.368491 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-71ed28af-6344-4c5c-b751-08445562c173 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:53.368953 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-71ed28af-6344-4c5c-b751-08445562c173 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:53.397546 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-71ed28af-6344-4c5c-b751-08445562c173 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Going to try to terminate instance {{(pid=120709) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:34:53.406505 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-fa0a1ca0-5fab-4a91-9377-63706981a7bd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:53.407004 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-fa0a1ca0-5fab-4a91-9377-63706981a7bd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:53.413002 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fa0a1ca0-5fab-4a91-9377-63706981a7bd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:53.413483 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fa0a1ca0-5fab-4a91-9377-63706981a7bd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:53.413920 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fa0a1ca0-5fab-4a91-9377-63706981a7bd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:53.414611 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fa0a1ca0-5fab-4a91-9377-63706981a7bd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:53.415068 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fa0a1ca0-5fab-4a91-9377-63706981a7bd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:53.415497 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fa0a1ca0-5fab-4a91-9377-63706981a7bd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:53.479205 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-71ed28af-6344-4c5c-b751-08445562c173 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "DELETE /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 204 len: 0 microversion: 2.1 time: 0.125868 Aug 24 03:34:53.479963 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 265/525] 10.222.0.81 () {58 vars in 1239 bytes} [Wed Aug 24 03:34:53 2022] DELETE /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:34:53.488892 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-863700fd-e688-47c1-9a15-537279b24aa7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:53.489407 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-863700fd-e688-47c1-9a15-537279b24aa7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:53.495283 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-863700fd-e688-47c1-9a15-537279b24aa7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:53.495764 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-863700fd-e688-47c1-9a15-537279b24aa7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:53.496229 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-863700fd-e688-47c1-9a15-537279b24aa7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:53.497473 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-863700fd-e688-47c1-9a15-537279b24aa7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:53.498283 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-863700fd-e688-47c1-9a15-537279b24aa7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:53.498403 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-863700fd-e688-47c1-9a15-537279b24aa7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:53.509527 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.objects.instance [None req-fa0a1ca0-5fab-4a91-9377-63706981a7bd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lazy-loading 'services' on Instance uuid 4a89effc-2ad4-414e-bca5-d503b48fb040 {{(pid=120708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:34:53.593611 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-fa0a1ca0-5fab-4a91-9377-63706981a7bd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "DELETE /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040/os-volume_attachments/7b7dc90a-d27d-4673-8c6f-161c801916b4" status: 202 len: 0 microversion: 2.20 time: 0.191557 Aug 24 03:34:53.594177 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 261/526] 10.222.0.81 () {60 vars in 1457 bytes} [Wed Aug 24 03:34:53 2022] DELETE /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040/os-volume_attachments/7b7dc90a-d27d-4673-8c6f-161c801916b4 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:34:53.603104 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-70e34b04-9451-41e6-8452-d46f13a561f3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:53.605449 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-70e34b04-9451-41e6-8452-d46f13a561f3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:53.612433 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-70e34b04-9451-41e6-8452-d46f13a561f3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:53.612955 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-70e34b04-9451-41e6-8452-d46f13a561f3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:53.613404 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-70e34b04-9451-41e6-8452-d46f13a561f3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:53.614099 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-70e34b04-9451-41e6-8452-d46f13a561f3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:53.614555 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-70e34b04-9451-41e6-8452-d46f13a561f3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:53.614979 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-70e34b04-9451-41e6-8452-d46f13a561f3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:53.637402 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-863700fd-e688-47c1-9a15-537279b24aa7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:53.646289 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-863700fd-e688-47c1-9a15-537279b24aa7 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1689 microversion: 2.1 time: 0.161971 Aug 24 03:34:53.646471 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-70e34b04-9451-41e6-8452-d46f13a561f3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047436 Aug 24 03:34:53.646866 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 262/528] 10.222.0.81 () {60 vars in 1343 bytes} [Wed Aug 24 03:34:53 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:34:53.647003 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 266/528] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:53 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:54.659717 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-5fb6233c-b618-42bb-a929-7f8f41ae66f2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:54.661984 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-5fb6233c-b618-42bb-a929-7f8f41ae66f2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:54.667436 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-63d63055-c3ac-45f7-a6f8-c99c6797a1d1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:54.668044 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-63d63055-c3ac-45f7-a6f8-c99c6797a1d1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:54.668583 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5fb6233c-b618-42bb-a929-7f8f41ae66f2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:54.669150 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5fb6233c-b618-42bb-a929-7f8f41ae66f2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:54.669692 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5fb6233c-b618-42bb-a929-7f8f41ae66f2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:54.670398 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5fb6233c-b618-42bb-a929-7f8f41ae66f2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:54.670865 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5fb6233c-b618-42bb-a929-7f8f41ae66f2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:54.671304 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5fb6233c-b618-42bb-a929-7f8f41ae66f2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:54.674812 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-63d63055-c3ac-45f7-a6f8-c99c6797a1d1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:54.675294 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-63d63055-c3ac-45f7-a6f8-c99c6797a1d1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:54.675727 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-63d63055-c3ac-45f7-a6f8-c99c6797a1d1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:54.676410 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-63d63055-c3ac-45f7-a6f8-c99c6797a1d1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:54.676882 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-63d63055-c3ac-45f7-a6f8-c99c6797a1d1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:54.677361 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-63d63055-c3ac-45f7-a6f8-c99c6797a1d1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:54.700963 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-5fb6233c-b618-42bb-a929-7f8f41ae66f2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044695 Aug 24 03:34:54.701531 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 267/529] 10.222.0.81 () {60 vars in 1343 bytes} [Wed Aug 24 03:34:54 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:34:54.809175 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-63d63055-c3ac-45f7-a6f8-c99c6797a1d1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:54.817437 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-63d63055-c3ac-45f7-a6f8-c99c6797a1d1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1689 microversion: 2.1 time: 0.153857 Aug 24 03:34:54.817996 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 263/530] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:54 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:55.713066 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-15a70cbc-6e54-49f0-ab8d-62e1c5f9ca71 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:55.715211 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-15a70cbc-6e54-49f0-ab8d-62e1c5f9ca71 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:55.722879 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-15a70cbc-6e54-49f0-ab8d-62e1c5f9ca71 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:55.723362 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-15a70cbc-6e54-49f0-ab8d-62e1c5f9ca71 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:55.723800 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-15a70cbc-6e54-49f0-ab8d-62e1c5f9ca71 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:55.724491 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-15a70cbc-6e54-49f0-ab8d-62e1c5f9ca71 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:55.724966 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-15a70cbc-6e54-49f0-ab8d-62e1c5f9ca71 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:55.725398 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-15a70cbc-6e54-49f0-ab8d-62e1c5f9ca71 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:55.755135 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-15a70cbc-6e54-49f0-ab8d-62e1c5f9ca71 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046155 Aug 24 03:34:55.755699 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 268/531] 10.222.0.81 () {60 vars in 1343 bytes} [Wed Aug 24 03:34:55 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:34:55.839222 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1d071311-a673-4e4e-92f6-09b162bd05ba tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:55.839833 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1d071311-a673-4e4e-92f6-09b162bd05ba tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:55.847532 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1d071311-a673-4e4e-92f6-09b162bd05ba tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:55.848015 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1d071311-a673-4e4e-92f6-09b162bd05ba tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:55.848452 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1d071311-a673-4e4e-92f6-09b162bd05ba tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:55.849166 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1d071311-a673-4e4e-92f6-09b162bd05ba tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:55.849622 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1d071311-a673-4e4e-92f6-09b162bd05ba tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:55.850046 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1d071311-a673-4e4e-92f6-09b162bd05ba tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:55.979564 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1d071311-a673-4e4e-92f6-09b162bd05ba tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:55.987629 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1d071311-a673-4e4e-92f6-09b162bd05ba tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1689 microversion: 2.1 time: 0.152318 Aug 24 03:34:55.988189 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 264/532] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:55 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:56.767565 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-d01ca6c5-3324-4a9f-a37a-497774594975 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:56.769768 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-d01ca6c5-3324-4a9f-a37a-497774594975 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:56.776144 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d01ca6c5-3324-4a9f-a37a-497774594975 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:56.776630 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d01ca6c5-3324-4a9f-a37a-497774594975 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:56.777117 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d01ca6c5-3324-4a9f-a37a-497774594975 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:56.777808 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d01ca6c5-3324-4a9f-a37a-497774594975 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:56.778485 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d01ca6c5-3324-4a9f-a37a-497774594975 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:56.779034 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d01ca6c5-3324-4a9f-a37a-497774594975 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:56.808134 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-d01ca6c5-3324-4a9f-a37a-497774594975 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044637 Aug 24 03:34:56.808712 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 269/533] 10.222.0.81 () {60 vars in 1343 bytes} [Wed Aug 24 03:34:56 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:34:57.008628 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-fa1100d6-c3a6-475d-a8d4-08bf182d896b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:57.009277 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-fa1100d6-c3a6-475d-a8d4-08bf182d896b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:57.015717 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fa1100d6-c3a6-475d-a8d4-08bf182d896b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:57.016201 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fa1100d6-c3a6-475d-a8d4-08bf182d896b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:57.016635 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fa1100d6-c3a6-475d-a8d4-08bf182d896b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:57.017351 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fa1100d6-c3a6-475d-a8d4-08bf182d896b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:57.017860 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fa1100d6-c3a6-475d-a8d4-08bf182d896b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:57.018231 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fa1100d6-c3a6-475d-a8d4-08bf182d896b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:57.157733 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-fa1100d6-c3a6-475d-a8d4-08bf182d896b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:57.165451 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-fa1100d6-c3a6-475d-a8d4-08bf182d896b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1689 microversion: 2.1 time: 0.160677 Aug 24 03:34:57.166012 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 265/534] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:57 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:57.822609 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-da80cde7-f2e9-4ce0-b721-a6beac0ed640 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:57.824877 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-da80cde7-f2e9-4ce0-b721-a6beac0ed640 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:57.831493 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-da80cde7-f2e9-4ce0-b721-a6beac0ed640 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:57.832094 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-da80cde7-f2e9-4ce0-b721-a6beac0ed640 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:57.832608 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-da80cde7-f2e9-4ce0-b721-a6beac0ed640 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:57.833490 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-da80cde7-f2e9-4ce0-b721-a6beac0ed640 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:57.834133 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-da80cde7-f2e9-4ce0-b721-a6beac0ed640 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:57.834833 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-da80cde7-f2e9-4ce0-b721-a6beac0ed640 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:57.865642 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-da80cde7-f2e9-4ce0-b721-a6beac0ed640 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047109 Aug 24 03:34:57.866199 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 270/535] 10.222.0.81 () {60 vars in 1343 bytes} [Wed Aug 24 03:34:57 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:34:58.187954 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b13b0d97-5eb5-45b2-a377-94cd4d06b598 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:58.188511 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-b13b0d97-5eb5-45b2-a377-94cd4d06b598 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:58.195308 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b13b0d97-5eb5-45b2-a377-94cd4d06b598 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:58.195797 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b13b0d97-5eb5-45b2-a377-94cd4d06b598 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:58.196229 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b13b0d97-5eb5-45b2-a377-94cd4d06b598 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:58.196974 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b13b0d97-5eb5-45b2-a377-94cd4d06b598 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:58.197430 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b13b0d97-5eb5-45b2-a377-94cd4d06b598 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:58.197858 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b13b0d97-5eb5-45b2-a377-94cd4d06b598 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:58.333790 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-b13b0d97-5eb5-45b2-a377-94cd4d06b598 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:58.341944 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-b13b0d97-5eb5-45b2-a377-94cd4d06b598 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1689 microversion: 2.1 time: 0.158104 Aug 24 03:34:58.342712 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 266/536] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:58 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:58.681902 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-aa19deb1-23c7-4728-ae0a-3cb6c0c266de req-3dfec82c-419c-41a8-9c67-cdf4e1ada107 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a6c958-f0bd-4b52-ab2c-15ff7e7b1280", "name": "network-vif-deleted", "tag": "7def1576-8e43-41f3-b534-e7a7b46f1b54"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:58.693281 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-aa19deb1-23c7-4728-ae0a-3cb6c0c266de req-3dfec82c-419c-41a8-9c67-cdf4e1ada107 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:58.693764 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-aa19deb1-23c7-4728-ae0a-3cb6c0c266de req-3dfec82c-419c-41a8-9c67-cdf4e1ada107 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:58.694197 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-aa19deb1-23c7-4728-ae0a-3cb6c0c266de req-3dfec82c-419c-41a8-9c67-cdf4e1ada107 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:58.707198 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-aa19deb1-23c7-4728-ae0a-3cb6c0c266de req-3dfec82c-419c-41a8-9c67-cdf4e1ada107 service nova] Creating event network-vif-deleted:7def1576-8e43-41f3-b534-e7a7b46f1b54 for instance 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 on hv-cinder-85426 Aug 24 03:34:58.712563 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-aa19deb1-23c7-4728-ae0a-3cb6c0c266de req-3dfec82c-419c-41a8-9c67-cdf4e1ada107 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034823 Aug 24 03:34:58.713425 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 271/537] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:58.878870 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-fe07b029-80e6-47dd-8b0e-cc03634ed586 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:58.881387 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-fe07b029-80e6-47dd-8b0e-cc03634ed586 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:58.888381 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fe07b029-80e6-47dd-8b0e-cc03634ed586 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:58.893297 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fe07b029-80e6-47dd-8b0e-cc03634ed586 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:58.893297 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fe07b029-80e6-47dd-8b0e-cc03634ed586 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:58.893297 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fe07b029-80e6-47dd-8b0e-cc03634ed586 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:58.893297 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fe07b029-80e6-47dd-8b0e-cc03634ed586 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:58.893678 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fe07b029-80e6-47dd-8b0e-cc03634ed586 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:58.926029 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-fe07b029-80e6-47dd-8b0e-cc03634ed586 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050980 Aug 24 03:34:58.927056 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 267/538] 10.222.0.81 () {60 vars in 1343 bytes} [Wed Aug 24 03:34:58 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:58.990596 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-edae2917-9ae3-44f5-9cc7-51237ab9981a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:58.991212 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-edae2917-9ae3-44f5-9cc7-51237ab9981a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:58.999117 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-edae2917-9ae3-44f5-9cc7-51237ab9981a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:58.999617 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-edae2917-9ae3-44f5-9cc7-51237ab9981a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:59.000056 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-edae2917-9ae3-44f5-9cc7-51237ab9981a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:59.000792 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-edae2917-9ae3-44f5-9cc7-51237ab9981a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:59.001250 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-edae2917-9ae3-44f5-9cc7-51237ab9981a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:59.001675 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-edae2917-9ae3-44f5-9cc7-51237ab9981a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:59.030473 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-edae2917-9ae3-44f5-9cc7-51237ab9981a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Going to try to terminate instance {{(pid=120709) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:34:59.110189 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-edae2917-9ae3-44f5-9cc7-51237ab9981a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "DELETE /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 204 len: 0 microversion: 2.20 time: 0.123730 Aug 24 03:34:59.110777 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 272/539] 10.222.0.81 () {60 vars in 1280 bytes} [Wed Aug 24 03:34:58 2022] DELETE /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 03:34:59.119083 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f6550e94-14f2-4864-ac44-72b20f56d716 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:59.119691 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f6550e94-14f2-4864-ac44-72b20f56d716 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:59.126707 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f6550e94-14f2-4864-ac44-72b20f56d716 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:59.127201 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f6550e94-14f2-4864-ac44-72b20f56d716 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:59.127670 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f6550e94-14f2-4864-ac44-72b20f56d716 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:59.128413 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f6550e94-14f2-4864-ac44-72b20f56d716 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:59.128940 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f6550e94-14f2-4864-ac44-72b20f56d716 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:59.129368 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f6550e94-14f2-4864-ac44-72b20f56d716 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:59.267821 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f6550e94-14f2-4864-ac44-72b20f56d716 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:59.276176 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f6550e94-14f2-4864-ac44-72b20f56d716 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:59.277809 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f6550e94-14f2-4864-ac44-72b20f56d716 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:59.279674 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f6550e94-14f2-4864-ac44-72b20f56d716 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1722 microversion: 2.20 time: 0.164405 Aug 24 03:34:59.280458 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 268/540] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:34:59 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:34:59.364212 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-5814bd3e-46f4-44ca-8d1b-80994f13f9f1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:59.365115 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-5814bd3e-46f4-44ca-8d1b-80994f13f9f1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:59.371019 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5814bd3e-46f4-44ca-8d1b-80994f13f9f1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:59.372070 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5814bd3e-46f4-44ca-8d1b-80994f13f9f1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:59.373102 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5814bd3e-46f4-44ca-8d1b-80994f13f9f1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:59.373807 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5814bd3e-46f4-44ca-8d1b-80994f13f9f1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:59.374267 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5814bd3e-46f4-44ca-8d1b-80994f13f9f1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:59.374692 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5814bd3e-46f4-44ca-8d1b-80994f13f9f1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:59.408678 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5814bd3e-46f4-44ca-8d1b-80994f13f9f1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:59.409213 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5814bd3e-46f4-44ca-8d1b-80994f13f9f1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:59.409648 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5814bd3e-46f4-44ca-8d1b-80994f13f9f1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:59.410094 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.objects.instance [None req-5814bd3e-46f4-44ca-8d1b-80994f13f9f1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lazy-loading 'fault' on Instance uuid 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 {{(pid=120709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:34:59.458396 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-5814bd3e-46f4-44ca-8d1b-80994f13f9f1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:59.466537 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-5814bd3e-46f4-44ca-8d1b-80994f13f9f1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1335 microversion: 2.1 time: 0.106696 Aug 24 03:34:59.467114 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 273/541] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:59 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1335 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:00.303156 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ac35dc52-e2e8-4778-9be4-0625b51f1dd9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:00.303701 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ac35dc52-e2e8-4778-9be4-0625b51f1dd9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:00.310443 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ac35dc52-e2e8-4778-9be4-0625b51f1dd9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:00.310922 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ac35dc52-e2e8-4778-9be4-0625b51f1dd9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:00.311360 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ac35dc52-e2e8-4778-9be4-0625b51f1dd9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:00.312045 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ac35dc52-e2e8-4778-9be4-0625b51f1dd9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:00.312498 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ac35dc52-e2e8-4778-9be4-0625b51f1dd9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:00.312955 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ac35dc52-e2e8-4778-9be4-0625b51f1dd9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:00.450080 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ac35dc52-e2e8-4778-9be4-0625b51f1dd9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:00.458255 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ac35dc52-e2e8-4778-9be4-0625b51f1dd9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:00.459773 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ac35dc52-e2e8-4778-9be4-0625b51f1dd9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:00.460954 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ac35dc52-e2e8-4778-9be4-0625b51f1dd9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1722 microversion: 2.20 time: 0.161786 Aug 24 03:35:00.461513 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 269/542] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:00 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:00.487841 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-c321f851-5e1a-433b-887b-1e70979e89b2 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:00.488451 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-c321f851-5e1a-433b-887b-1e70979e89b2 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:00.494728 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c321f851-5e1a-433b-887b-1e70979e89b2 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:00.495212 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c321f851-5e1a-433b-887b-1e70979e89b2 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:00.495654 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c321f851-5e1a-433b-887b-1e70979e89b2 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:00.496338 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c321f851-5e1a-433b-887b-1e70979e89b2 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:00.497075 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c321f851-5e1a-433b-887b-1e70979e89b2 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:00.497376 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c321f851-5e1a-433b-887b-1e70979e89b2 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:00.527595 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c321f851-5e1a-433b-887b-1e70979e89b2 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:00.528682 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c321f851-5e1a-433b-887b-1e70979e89b2 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:00.529182 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c321f851-5e1a-433b-887b-1e70979e89b2 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:00.529625 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.objects.instance [None req-c321f851-5e1a-433b-887b-1e70979e89b2 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lazy-loading 'fault' on Instance uuid 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 {{(pid=120709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:35:00.570838 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-c321f851-5e1a-433b-887b-1e70979e89b2 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:00.579213 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-c321f851-5e1a-433b-887b-1e70979e89b2 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 200 len: 1335 microversion: 2.1 time: 0.095283 Aug 24 03:35:00.579773 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 274/543] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:00 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 1335 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:01.486291 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-41551544-c7d2-402c-8019-0050a4b6ebea tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:01.486873 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-41551544-c7d2-402c-8019-0050a4b6ebea tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:01.493563 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-41551544-c7d2-402c-8019-0050a4b6ebea tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:01.494050 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-41551544-c7d2-402c-8019-0050a4b6ebea tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:01.494487 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-41551544-c7d2-402c-8019-0050a4b6ebea tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:01.495185 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-41551544-c7d2-402c-8019-0050a4b6ebea tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:01.495635 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-41551544-c7d2-402c-8019-0050a4b6ebea tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:01.496064 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-41551544-c7d2-402c-8019-0050a4b6ebea tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:01.601004 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-075b52b2-0ca4-462d-abac-230bbbb3f9f5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:01.601618 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-075b52b2-0ca4-462d-abac-230bbbb3f9f5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:01.609587 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-075b52b2-0ca4-462d-abac-230bbbb3f9f5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:01.610411 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-075b52b2-0ca4-462d-abac-230bbbb3f9f5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:01.610914 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-075b52b2-0ca4-462d-abac-230bbbb3f9f5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:01.611680 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-075b52b2-0ca4-462d-abac-230bbbb3f9f5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:01.612296 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-075b52b2-0ca4-462d-abac-230bbbb3f9f5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:01.612722 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-075b52b2-0ca4-462d-abac-230bbbb3f9f5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:01.627581 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.wsgi [None req-075b52b2-0ca4-462d-abac-230bbbb3f9f5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] HTTP exception thrown: Instance 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 could not be found. Aug 24 03:35:01.629308 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-075b52b2-0ca4-462d-abac-230bbbb3f9f5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Request method failure captured: Aug 24 03:35:01.629308 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: request: GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 HTTP/1.1 Aug 24 03:35:01.629308 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept: application/json Aug 24 03:35:01.629308 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept-Encoding: identity Aug 24 03:35:01.629308 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Connection: close Aug 24 03:35:01.629308 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Length: 0 Aug 24 03:35:01.629308 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Type: application/json Aug 24 03:35:01.629308 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Host: 10.222.0.81 Aug 24 03:35:01.629308 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Openstack-System-Scope: None Aug 24 03:35:01.629308 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: User-Agent: python-urllib3/1.26.11 Aug 24 03:35:01.629308 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Auth-Token: gAAAAABjBZtELohYIAWnqjydeh3nWBVxVzNmFojSvJiXirJze4xCW5UrBoFNDSrYI2MQuwDBgKCF0rIi4_RidefSOe-gruz8glzTk9P0i0YWWK0Ls_tkgBqEsg07AX095VUNsx8SXSrVeXxD-FtuxDYQ-PAYt2BeP7o3wF-sE_NMuIwVCtJS2k0 Aug 24 03:35:01.629308 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Id: None Aug 24 03:35:01.629308 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Name: None Aug 24 03:35:01.629308 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Identity-Status: Confirmed Aug 24 03:35:01.629308 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Is-Admin-Project: True Aug 24 03:35:01.629308 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Id: default Aug 24 03:35:01.629308 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Name: Default Aug 24 03:35:01.629308 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Id: 625e6391470e4018a6c502219b3d2b15 Aug 24 03:35:01.629308 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1294945241 Aug 24 03:35:01.629308 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Role: reader,member Aug 24 03:35:01.629308 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Roles: reader,member Aug 24 03:35:01.630863 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/625e6391470e4018a6c502219b3d2b15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_625e6391470e4018a6c502219b3d2b15", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/625e6391470e4018a6c502219b3d2b15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/625e6391470e4018a6c502219b3d2b15"}]}] Aug 24 03:35:01.630863 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1294945241 Aug 24 03:35:01.630863 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Id: 625e6391470e4018a6c502219b3d2b15 Aug 24 03:35:01.630863 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1294945241 Aug 24 03:35:01.630863 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User: tempest-ServerRescueNegativeTestJSON-1294945241-project Aug 24 03:35:01.630863 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Id: default Aug 24 03:35:01.630863 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Name: Default Aug 24 03:35:01.630863 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Id: 33b932f3feb342d889155c3c34407a88 Aug 24 03:35:01.630863 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1294945241-project Aug 24 03:35:01.630863 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: method: > Aug 24 03:35:01.630863 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: exception: Instance 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 could not be found. Aug 24 03:35:01.630863 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: action_args: {'id': '76a6c958-f0bd-4b52-ab2c-15ff7e7b1280'} Aug 24 03:35:01.631722 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:35:01.631722 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:01.631722 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:35:01.631722 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:35:01.631722 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:35:01.631722 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:35:01.631722 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:35:01.631722 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:35:01.631722 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:35:01.631722 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:35:01.631722 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 could not be found. Aug 24 03:35:01.631722 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:35:01.631722 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:01.631722 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:35:01.631722 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:01.631722 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:01.631722 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:01.631722 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:35:01.631722 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:35:01.631722 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:35:01.633080 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:35:01.633080 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:35:01.633080 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:35:01.633080 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:35:01.633080 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:35:01.633080 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:35:01.633080 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:35:01.633080 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 could not be found. Aug 24 03:35:01.633080 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:35:01.633080 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:01.633080 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:35:01.633080 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:01.633080 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:01.633080 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:01.633080 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:35:01.633080 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:35:01.633080 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 could not be found. Aug 24 03:35:01.633080 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:35:01.634697 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-41551544-c7d2-402c-8019-0050a4b6ebea tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:01.635403 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-075b52b2-0ca4-462d-abac-230bbbb3f9f5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Returning 404 to user: Instance 76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 could not be found. {{(pid=120709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:35:01.637425 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-075b52b2-0ca4-462d-abac-230bbbb3f9f5 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280" status: 404 len: 111 microversion: 2.1 time: 0.040209 Aug 24 03:35:01.638750 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 275/544] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:01 2022] GET /compute/v2.1/servers/76a6c958-f0bd-4b52-ab2c-15ff7e7b1280 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:35:01.646641 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-5e26d89a-8ce8-4b93-a9c9-2db0d360dffb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '.version_select at 0x7f942f4679d0>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:01.646800 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-41551544-c7d2-402c-8019-0050a4b6ebea tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:01.648346 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-41551544-c7d2-402c-8019-0050a4b6ebea tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:01.649576 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-41551544-c7d2-402c-8019-0050a4b6ebea tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 200 len: 1722 microversion: 2.20 time: 0.167295 Aug 24 03:35:01.650630 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 270/545] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:01 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:01.683549 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-5e26d89a-8ce8-4b93-a9c9-2db0d360dffb tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-356678355" status: 202 len: 0 microversion: 2.1 time: 0.040659 Aug 24 03:35:01.684866 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 276/546] 10.222.0.81 () {58 vars in 1218 bytes} [Wed Aug 24 03:35:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-356678355 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:35:01.972499 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-52b5af85-f69d-464f-b73a-41ee3f81b217 req-ae8cbe04-d016-4175-8801-acf6363c7c80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a89effc-2ad4-414e-bca5-d503b48fb040", "name": "network-vif-deleted", "tag": "57289a66-609a-46ea-b8c8-5258bbaf0864"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:01.984251 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-52b5af85-f69d-464f-b73a-41ee3f81b217 req-ae8cbe04-d016-4175-8801-acf6363c7c80 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:01.984725 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-52b5af85-f69d-464f-b73a-41ee3f81b217 req-ae8cbe04-d016-4175-8801-acf6363c7c80 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:01.985408 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-52b5af85-f69d-464f-b73a-41ee3f81b217 req-ae8cbe04-d016-4175-8801-acf6363c7c80 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:01.998366 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-52b5af85-f69d-464f-b73a-41ee3f81b217 req-ae8cbe04-d016-4175-8801-acf6363c7c80 service nova] Creating event network-vif-deleted:57289a66-609a-46ea-b8c8-5258bbaf0864 for instance 4a89effc-2ad4-414e-bca5-d503b48fb040 on hv-cinder-85426 Aug 24 03:35:02.003815 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-52b5af85-f69d-464f-b73a-41ee3f81b217 req-ae8cbe04-d016-4175-8801-acf6363c7c80 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035431 Aug 24 03:35:02.008338 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 271/547] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:02.676484 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-91281c7a-69ae-4758-9ae3-cc2de2a4efa2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:02.677125 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-91281c7a-69ae-4758-9ae3-cc2de2a4efa2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:02.684070 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-91281c7a-69ae-4758-9ae3-cc2de2a4efa2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:02.684070 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-91281c7a-69ae-4758-9ae3-cc2de2a4efa2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:02.684947 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-91281c7a-69ae-4758-9ae3-cc2de2a4efa2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:02.685868 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-91281c7a-69ae-4758-9ae3-cc2de2a4efa2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:02.686323 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-91281c7a-69ae-4758-9ae3-cc2de2a4efa2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:02.686742 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-91281c7a-69ae-4758-9ae3-cc2de2a4efa2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:02.702228 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.wsgi [None req-91281c7a-69ae-4758-9ae3-cc2de2a4efa2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] HTTP exception thrown: Instance 4a89effc-2ad4-414e-bca5-d503b48fb040 could not be found. Aug 24 03:35:02.704014 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-91281c7a-69ae-4758-9ae3-cc2de2a4efa2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Request method failure captured: Aug 24 03:35:02.704014 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: request: GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 HTTP/1.1 Aug 24 03:35:02.704014 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept: application/json Aug 24 03:35:02.704014 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept-Encoding: identity Aug 24 03:35:02.704014 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Connection: close Aug 24 03:35:02.704014 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Length: 0 Aug 24 03:35:02.704014 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Type: application/json Aug 24 03:35:02.704014 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Host: 10.222.0.81 Aug 24 03:35:02.704014 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Openstack-System-Scope: None Aug 24 03:35:02.704014 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: User-Agent: python-urllib3/1.26.11 Aug 24 03:35:02.704014 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Auth-Token: gAAAAABjBZuU5Ur16JA0Q33qyxvYzcFhUDzzzqyl8J3qPAx9L5VQ_xCO9RNsAHrl_suhajqqZOhJFrFAlz0L2fhPtzn3BHE_P6zVIMdZwTDQWkyrUNMoknDnQrZUczvh8w364-XN8VgV8x_z6gHGZYF0jODp-A2xaDd9dGqTknsxFOz7yOgL_Pg Aug 24 03:35:02.704014 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Id: None Aug 24 03:35:02.704014 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Name: None Aug 24 03:35:02.704014 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Identity-Status: Confirmed Aug 24 03:35:02.704014 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Is-Admin-Project: True Aug 24 03:35:02.704014 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 03:35:02.704014 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Id: default Aug 24 03:35:02.704014 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Name: Default Aug 24 03:35:02.704014 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Id: b5da9e76bed44f3d90144e4fbff2cb1c Aug 24 03:35:02.704014 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1702847769 Aug 24 03:35:02.704014 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Role: reader,member Aug 24 03:35:02.704014 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Roles: reader,member Aug 24 03:35:02.706075 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b5da9e76bed44f3d90144e4fbff2cb1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_b5da9e76bed44f3d90144e4fbff2cb1c", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b5da9e76bed44f3d90144e4fbff2cb1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/b5da9e76bed44f3d90144e4fbff2cb1c"}]}] Aug 24 03:35:02.706075 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1702847769 Aug 24 03:35:02.706075 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Id: b5da9e76bed44f3d90144e4fbff2cb1c Aug 24 03:35:02.706075 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1702847769 Aug 24 03:35:02.706075 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User: tempest-AttachVolumeShelveTestJSON-1702847769-project Aug 24 03:35:02.706075 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Id: default Aug 24 03:35:02.706075 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Name: Default Aug 24 03:35:02.706075 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Id: 1af20de2433c44ff8fb1f16290404c21 Aug 24 03:35:02.706075 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1702847769-project Aug 24 03:35:02.706075 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: method: > Aug 24 03:35:02.706075 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: exception: Instance 4a89effc-2ad4-414e-bca5-d503b48fb040 could not be found. Aug 24 03:35:02.706075 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: action_args: {'id': '4a89effc-2ad4-414e-bca5-d503b48fb040'} Aug 24 03:35:02.706961 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:35:02.706961 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:02.706961 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:35:02.706961 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:35:02.706961 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:35:02.706961 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:35:02.706961 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:35:02.706961 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:35:02.706961 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:35:02.706961 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:35:02.706961 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a89effc-2ad4-414e-bca5-d503b48fb040 could not be found. Aug 24 03:35:02.706961 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:35:02.706961 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:02.706961 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:35:02.706961 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:02.706961 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:02.706961 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:02.706961 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:35:02.706961 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:35:02.706961 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:35:02.708099 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:35:02.708099 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:35:02.708099 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:35:02.708099 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:35:02.708099 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:35:02.708099 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:35:02.708099 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:35:02.708099 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a89effc-2ad4-414e-bca5-d503b48fb040 could not be found. Aug 24 03:35:02.708099 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:35:02.708099 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:02.708099 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:35:02.708099 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:02.708099 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:02.708099 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:02.708099 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:35:02.708099 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:35:02.708099 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a89effc-2ad4-414e-bca5-d503b48fb040 could not be found. Aug 24 03:35:02.708099 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:35:02.709172 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-91281c7a-69ae-4758-9ae3-cc2de2a4efa2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Returning 404 to user: Instance 4a89effc-2ad4-414e-bca5-d503b48fb040 could not be found. {{(pid=120709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:35:02.709172 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-91281c7a-69ae-4758-9ae3-cc2de2a4efa2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 404 len: 111 microversion: 2.20 time: 0.033431 Aug 24 03:35:02.709172 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 277/548] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:02 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:35:02.716131 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-5abe6d06-76da-4f64-b8cd-a5366d0df926 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '.version_select at 0x7f942f28df70>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:02.736165 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-5abe6d06-76da-4f64-b8cd-a5366d0df926 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-681882413" status: 204 len: 0 microversion: 2.20 time: 0.025223 Aug 24 03:35:02.740154 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 272/549] 10.222.0.81 () {60 vars in 1259 bytes} [Wed Aug 24 03:35:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-681882413 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 03:35:03.410477 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-704bf045-4f0c-4211-b9d3-63f2edf88f40 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Action: 'create', calling method: .version_select at 0x7f942ff9c3a0>, body: {"keypair": {"name": "tempest-keypair-1367660773", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/xrIX2NxjWd7cM2yhYM5zUrfpv/5rbz8c/zgrKYvXCl+e0OlDOW6plH3CTAt0EztD14e6P+F+HePDksjuNEi4xbpDMK4SEY+fjFaKNs9ya7eVlmradmlC0jY2iNrzh/w=="}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:03.426548 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.quota [None req-704bf045-4f0c-4211-b9d3-63f2edf88f40 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Getting quotas for project b5da9e76bed44f3d90144e4fbff2cb1c. Resources: {'key_pairs'} {{(pid=120709) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:35:03.430443 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.quota [None req-704bf045-4f0c-4211-b9d3-63f2edf88f40 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Getting quotas for user 1af20de2433c44ff8fb1f16290404c21 and project b5da9e76bed44f3d90144e4fbff2cb1c. Resources: {'key_pairs'} {{(pid=120709) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:35:03.452730 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-704bf045-4f0c-4211-b9d3-63f2edf88f40 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.046145 Aug 24 03:35:03.453348 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 278/550] 10.222.0.81 () {62 vars in 1200 bytes} [Wed Aug 24 03:35:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 03:35:04.018707 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-6e8d05d4-5faf-4dad-b6af-f7a6446bf9a8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-907969095"}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:04.019355 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-6e8d05d4-5faf-4dad-b6af-f7a6446bf9a8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:04.025992 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6e8d05d4-5faf-4dad-b6af-f7a6446bf9a8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:04.026485 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6e8d05d4-5faf-4dad-b6af-f7a6446bf9a8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:04.026923 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6e8d05d4-5faf-4dad-b6af-f7a6446bf9a8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:04.028219 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6e8d05d4-5faf-4dad-b6af-f7a6446bf9a8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:04.028680 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6e8d05d4-5faf-4dad-b6af-f7a6446bf9a8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:04.029197 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6e8d05d4-5faf-4dad-b6af-f7a6446bf9a8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:04.266593 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.network.security_group_api [None req-6e8d05d4-5faf-4dad-b6af-f7a6446bf9a8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Removing security group 6dacf5a4-4fd7-4bce-b670-764f73bca386 from port 925d9bc5-c59a-44c2-9c0d-39c5bc93381b Aug 24 03:35:04.654536 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-08cbdcb0-035e-448e-9e74-3f36db157190 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:04.655081 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-08cbdcb0-035e-448e-9e74-3f36db157190 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:04.661714 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-08cbdcb0-035e-448e-9e74-3f36db157190 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:04.662242 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-08cbdcb0-035e-448e-9e74-3f36db157190 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:04.662687 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-08cbdcb0-035e-448e-9e74-3f36db157190 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:04.663390 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-08cbdcb0-035e-448e-9e74-3f36db157190 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:04.663845 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-08cbdcb0-035e-448e-9e74-3f36db157190 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:04.664290 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-08cbdcb0-035e-448e-9e74-3f36db157190 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:04.684851 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:04.693539 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-08cbdcb0-035e-448e-9e74-3f36db157190 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Going to try to terminate instance {{(pid=120709) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:35:04.776571 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-08cbdcb0-035e-448e-9e74-3f36db157190 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 204 len: 0 microversion: 2.1 time: 0.126212 Aug 24 03:35:04.777836 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 279/551] 10.222.0.81 () {58 vars in 1239 bytes} [Wed Aug 24 03:35:04 2022] DELETE /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:35:04.788179 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-28b273fc-1cb6-4223-ad7e-b59a46bc6397 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:04.788897 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-28b273fc-1cb6-4223-ad7e-b59a46bc6397 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:04.795435 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-28b273fc-1cb6-4223-ad7e-b59a46bc6397 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:04.795925 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-28b273fc-1cb6-4223-ad7e-b59a46bc6397 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:04.796357 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-28b273fc-1cb6-4223-ad7e-b59a46bc6397 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:04.797079 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-28b273fc-1cb6-4223-ad7e-b59a46bc6397 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:04.797528 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-28b273fc-1cb6-4223-ad7e-b59a46bc6397 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:04.797948 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-28b273fc-1cb6-4223-ad7e-b59a46bc6397 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:04.815812 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-6e8d05d4-5faf-4dad-b6af-f7a6446bf9a8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "POST /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f/action" status: 202 len: 0 microversion: 2.1 time: 0.800977 Aug 24 03:35:04.819756 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 273/552] 10.222.0.81 () {60 vars in 1278 bytes} [Wed Aug 24 03:35:04 2022] POST /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f/action => generated 0 bytes in 806 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:35:04.842406 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-b1794ed6-ce68-4946-989e-f9e22acef70d req-ac9bda7f-5306-406e-9e08-9bbdbde90523 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "733c5faa-7030-4ad2-9fe5-357ce22b115f", "tag": "925d9bc5-c59a-44c2-9c0d-39c5bc93381b"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:04.859277 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-b1794ed6-ce68-4946-989e-f9e22acef70d req-ac9bda7f-5306-406e-9e08-9bbdbde90523 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:04.863190 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-b1794ed6-ce68-4946-989e-f9e22acef70d req-ac9bda7f-5306-406e-9e08-9bbdbde90523 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:04.863781 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-b1794ed6-ce68-4946-989e-f9e22acef70d req-ac9bda7f-5306-406e-9e08-9bbdbde90523 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:04.883424 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-b1794ed6-ce68-4946-989e-f9e22acef70d req-ac9bda7f-5306-406e-9e08-9bbdbde90523 service nova] Creating event network-changed:925d9bc5-c59a-44c2-9c0d-39c5bc93381b for instance 733c5faa-7030-4ad2-9fe5-357ce22b115f on hv-cinder-85426 Aug 24 03:35:04.901356 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-b1794ed6-ce68-4946-989e-f9e22acef70d req-ac9bda7f-5306-406e-9e08-9bbdbde90523 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063847 Aug 24 03:35:04.910521 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 274/553] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:05.098033 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-28b273fc-1cb6-4223-ad7e-b59a46bc6397 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:05.107814 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-28b273fc-1cb6-4223-ad7e-b59a46bc6397 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1509 microversion: 2.1 time: 0.323775 Aug 24 03:35:05.108734 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 280/554] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:04 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1509 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:05.673447 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-9b062eda-83f5-4093-b96f-536e941af359 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1612436341", "imageRef": "b7a40f0c-20c2-44cd-8b0e-f6e73a007d3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "52ff60ab-ab6b-4793-b855-63432cd730d4"}], "security_groups": [{"name": "tempest-securitygroup--1951405486"}], "key_name": "tempest-keypair-1367660773", "user_data": "}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:05.803586 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.network.neutron [None req-9b062eda-83f5-4093-b96f-536e941af359 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] validate_networks() for [('52ff60ab-ab6b-4793-b855-63432cd730d4', None, None, None, None, None)] {{(pid=120708) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:35:06.128380 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-bde8ce27-be9c-4e62-956f-43ecfc20f323 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:06.129056 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-bde8ce27-be9c-4e62-956f-43ecfc20f323 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:06.135559 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bde8ce27-be9c-4e62-956f-43ecfc20f323 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:06.136057 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bde8ce27-be9c-4e62-956f-43ecfc20f323 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:06.136493 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bde8ce27-be9c-4e62-956f-43ecfc20f323 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:06.137847 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bde8ce27-be9c-4e62-956f-43ecfc20f323 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:06.138305 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bde8ce27-be9c-4e62-956f-43ecfc20f323 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:06.138768 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bde8ce27-be9c-4e62-956f-43ecfc20f323 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:06.458465 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-bde8ce27-be9c-4e62-956f-43ecfc20f323 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:06.466150 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-bde8ce27-be9c-4e62-956f-43ecfc20f323 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1509 microversion: 2.1 time: 0.341572 Aug 24 03:35:06.466919 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 281/555] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:06 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1509 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:06.552330 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-9b062eda-83f5-4093-b96f-536e941af359 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Flavor limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:35:06.552758 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-9b062eda-83f5-4093-b96f-536e941af359 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Image limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:35:06.553267 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-9b062eda-83f5-4093-b96f-536e941af359 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Flavor pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:35:06.553675 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-9b062eda-83f5-4093-b96f-536e941af359 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Image pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:35:06.554121 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-9b062eda-83f5-4093-b96f-536e941af359 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:35:06.568692 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9b062eda-83f5-4093-b96f-536e941af359 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:06.569285 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9b062eda-83f5-4093-b96f-536e941af359 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:06.569749 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9b062eda-83f5-4093-b96f-536e941af359 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:06.570529 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9b062eda-83f5-4093-b96f-536e941af359 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:06.570995 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9b062eda-83f5-4093-b96f-536e941af359 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:06.571443 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9b062eda-83f5-4093-b96f-536e941af359 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:06.588926 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-9b062eda-83f5-4093-b96f-536e941af359 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Getting quotas for project b5da9e76bed44f3d90144e4fbff2cb1c. Resources: {'ram', 'instances', 'cores'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:35:06.593854 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-9b062eda-83f5-4093-b96f-536e941af359 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Getting quotas for user 1af20de2433c44ff8fb1f16290404c21 and project b5da9e76bed44f3d90144e4fbff2cb1c. Resources: {'ram', 'instances', 'cores'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:35:06.606362 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-9b062eda-83f5-4093-b96f-536e941af359 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Going to run 1 instances... {{(pid=120708) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:35:06.608911 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-9b062eda-83f5-4093-b96f-536e941af359 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b7a40f0c-20c2-44cd-8b0e-f6e73a007d3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120708) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:35:06.658435 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-9b062eda-83f5-4093-b96f-536e941af359 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.989736 Aug 24 03:35:06.659448 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 275/556] 10.222.0.81 () {62 vars in 1188 bytes} [Wed Aug 24 03:35:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 991 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 03:35:06.685854 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-5947a10d-b08a-45ff-beb6-d2db7b7f4e7f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:06.686721 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-5947a10d-b08a-45ff-beb6-d2db7b7f4e7f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:06.714795 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-bfcd5487-6967-4b86-9e4e-315dcdb04753 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:06.716659 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-bfcd5487-6967-4b86-9e4e-315dcdb04753 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:06.725909 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bfcd5487-6967-4b86-9e4e-315dcdb04753 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:06.726777 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bfcd5487-6967-4b86-9e4e-315dcdb04753 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:06.727808 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bfcd5487-6967-4b86-9e4e-315dcdb04753 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:06.730819 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bfcd5487-6967-4b86-9e4e-315dcdb04753 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:06.730819 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bfcd5487-6967-4b86-9e4e-315dcdb04753 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:06.733120 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bfcd5487-6967-4b86-9e4e-315dcdb04753 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:06.754466 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-5947a10d-b08a-45ff-beb6-d2db7b7f4e7f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:06.758961 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:06.766323 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-5947a10d-b08a-45ff-beb6-d2db7b7f4e7f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:06.768214 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-5947a10d-b08a-45ff-beb6-d2db7b7f4e7f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:06.769707 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-5947a10d-b08a-45ff-beb6-d2db7b7f4e7f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1282 microversion: 2.20 time: 0.102111 Aug 24 03:35:06.770826 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 282/557] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:06 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1282 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:06.846720 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.objects.instance [None req-bfcd5487-6967-4b86-9e4e-315dcdb04753 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lazy-loading 'services' on Instance uuid 733c5faa-7030-4ad2-9fe5-357ce22b115f {{(pid=120708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:35:06.920813 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-adf54a66-5b78-4007-b9ec-3783c46ece1a req-ffda4e6b-b81f-4537-865e-a060d6c2836a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "733c5faa-7030-4ad2-9fe5-357ce22b115f", "tag": "925d9bc5-c59a-44c2-9c0d-39c5bc93381b"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:06.943867 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-adf54a66-5b78-4007-b9ec-3783c46ece1a req-ffda4e6b-b81f-4537-865e-a060d6c2836a service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:06.944433 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-adf54a66-5b78-4007-b9ec-3783c46ece1a req-ffda4e6b-b81f-4537-865e-a060d6c2836a service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:06.944909 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-adf54a66-5b78-4007-b9ec-3783c46ece1a req-ffda4e6b-b81f-4537-865e-a060d6c2836a service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:06.958541 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-bfcd5487-6967-4b86-9e4e-315dcdb04753 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "DELETE /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f/os-volume_attachments/e941ff04-8f46-4fd1-bc02-0b6a7ffdafb3" status: 202 len: 0 microversion: 2.1 time: 0.246766 Aug 24 03:35:06.959377 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 276/558] 10.222.0.81 () {58 vars in 1416 bytes} [Wed Aug 24 03:35:06 2022] DELETE /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f/os-volume_attachments/e941ff04-8f46-4fd1-bc02-0b6a7ffdafb3 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:35:06.968791 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-6e82408f-9183-4804-b294-c9900ffd9387 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:06.971772 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-6e82408f-9183-4804-b294-c9900ffd9387 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:06.975557 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-adf54a66-5b78-4007-b9ec-3783c46ece1a req-ffda4e6b-b81f-4537-865e-a060d6c2836a service nova] Creating event network-changed:925d9bc5-c59a-44c2-9c0d-39c5bc93381b for instance 733c5faa-7030-4ad2-9fe5-357ce22b115f on hv-cinder-85426 Aug 24 03:35:06.978499 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6e82408f-9183-4804-b294-c9900ffd9387 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:06.979069 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6e82408f-9183-4804-b294-c9900ffd9387 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:06.980412 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6e82408f-9183-4804-b294-c9900ffd9387 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:06.981847 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6e82408f-9183-4804-b294-c9900ffd9387 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:06.983012 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6e82408f-9183-4804-b294-c9900ffd9387 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:06.983334 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-adf54a66-5b78-4007-b9ec-3783c46ece1a req-ffda4e6b-b81f-4537-865e-a060d6c2836a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065692 Aug 24 03:35:06.983622 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6e82408f-9183-4804-b294-c9900ffd9387 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:06.984412 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 283/559] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:35:07.015132 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-6e82408f-9183-4804-b294-c9900ffd9387 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051240 Aug 24 03:35:07.016272 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 277/560] 10.222.0.81 () {58 vars in 1302 bytes} [Wed Aug 24 03:35:06 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:35:07.488435 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-ca3ff13a-5bb5-4bf7-8fe5-d35ba7d616e1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:07.489187 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-ca3ff13a-5bb5-4bf7-8fe5-d35ba7d616e1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:07.495389 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ca3ff13a-5bb5-4bf7-8fe5-d35ba7d616e1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:07.495875 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ca3ff13a-5bb5-4bf7-8fe5-d35ba7d616e1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:07.496911 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ca3ff13a-5bb5-4bf7-8fe5-d35ba7d616e1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:07.497622 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ca3ff13a-5bb5-4bf7-8fe5-d35ba7d616e1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:07.498087 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ca3ff13a-5bb5-4bf7-8fe5-d35ba7d616e1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:07.498519 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ca3ff13a-5bb5-4bf7-8fe5-d35ba7d616e1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:07.790075 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-ca3ff13a-5bb5-4bf7-8fe5-d35ba7d616e1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:07.791559 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d16be5b7-a96b-4d08-82b3-ded1442c2a2a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:07.792177 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d16be5b7-a96b-4d08-82b3-ded1442c2a2a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:07.803720 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-ca3ff13a-5bb5-4bf7-8fe5-d35ba7d616e1 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1509 microversion: 2.1 time: 0.319430 Aug 24 03:35:07.816815 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 284/561] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:07 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1509 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:07.817044 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d16be5b7-a96b-4d08-82b3-ded1442c2a2a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:07.817044 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d16be5b7-a96b-4d08-82b3-ded1442c2a2a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:07.817044 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d16be5b7-a96b-4d08-82b3-ded1442c2a2a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:07.817044 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d16be5b7-a96b-4d08-82b3-ded1442c2a2a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:07.817402 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d16be5b7-a96b-4d08-82b3-ded1442c2a2a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:07.817402 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d16be5b7-a96b-4d08-82b3-ded1442c2a2a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:07.918855 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d16be5b7-a96b-4d08-82b3-ded1442c2a2a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:07.929882 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d16be5b7-a96b-4d08-82b3-ded1442c2a2a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:07.931873 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d16be5b7-a96b-4d08-82b3-ded1442c2a2a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:07.933053 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d16be5b7-a96b-4d08-82b3-ded1442c2a2a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1334 microversion: 2.20 time: 0.145354 Aug 24 03:35:07.934245 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 278/562] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:07 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1334 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:35:08.027837 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-6bb307d3-6c30-456a-bdf0-7bb6b3805c3a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:08.030260 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-6bb307d3-6c30-456a-bdf0-7bb6b3805c3a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:08.036709 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6bb307d3-6c30-456a-bdf0-7bb6b3805c3a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:08.037219 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6bb307d3-6c30-456a-bdf0-7bb6b3805c3a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:08.037668 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6bb307d3-6c30-456a-bdf0-7bb6b3805c3a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:08.038466 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6bb307d3-6c30-456a-bdf0-7bb6b3805c3a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:08.038955 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6bb307d3-6c30-456a-bdf0-7bb6b3805c3a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:08.039387 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6bb307d3-6c30-456a-bdf0-7bb6b3805c3a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:08.074861 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-6bb307d3-6c30-456a-bdf0-7bb6b3805c3a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051032 Aug 24 03:35:08.075760 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 285/563] 10.222.0.81 () {58 vars in 1302 bytes} [Wed Aug 24 03:35:08 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:08.824992 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f0904f91-1635-432e-9370-ee28a4fd76c6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:08.825517 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f0904f91-1635-432e-9370-ee28a4fd76c6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:08.832436 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f0904f91-1635-432e-9370-ee28a4fd76c6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:08.832964 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f0904f91-1635-432e-9370-ee28a4fd76c6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:08.833408 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f0904f91-1635-432e-9370-ee28a4fd76c6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:08.834113 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f0904f91-1635-432e-9370-ee28a4fd76c6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:08.834569 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f0904f91-1635-432e-9370-ee28a4fd76c6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:08.834997 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f0904f91-1635-432e-9370-ee28a4fd76c6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:08.867020 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f0904f91-1635-432e-9370-ee28a4fd76c6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:08.867509 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f0904f91-1635-432e-9370-ee28a4fd76c6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:08.867942 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f0904f91-1635-432e-9370-ee28a4fd76c6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:08.868386 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.objects.instance [None req-f0904f91-1635-432e-9370-ee28a4fd76c6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lazy-loading 'fault' on Instance uuid 6fb4b6a3-5be8-48da-a564-3bf08b732fa5 {{(pid=120708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:35:08.919616 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f0904f91-1635-432e-9370-ee28a4fd76c6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:08.931121 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f0904f91-1635-432e-9370-ee28a4fd76c6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 200 len: 1312 microversion: 2.1 time: 0.110102 Aug 24 03:35:08.931940 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 279/564] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:08 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 1312 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:08.956984 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-5acd1baf-93b1-42f5-9bb2-c325ffbccef2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:08.958197 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-5acd1baf-93b1-42f5-9bb2-c325ffbccef2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:08.965367 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5acd1baf-93b1-42f5-9bb2-c325ffbccef2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:08.965861 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5acd1baf-93b1-42f5-9bb2-c325ffbccef2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:08.966502 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5acd1baf-93b1-42f5-9bb2-c325ffbccef2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:08.967378 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5acd1baf-93b1-42f5-9bb2-c325ffbccef2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:08.967840 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5acd1baf-93b1-42f5-9bb2-c325ffbccef2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:08.968453 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5acd1baf-93b1-42f5-9bb2-c325ffbccef2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:09.004932 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-d5751ae1-c50f-4eed-98c9-3600f3e44ded req-588cb25b-644b-4f03-a43d-cd7f172b8623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fb4b6a3-5be8-48da-a564-3bf08b732fa5", "name": "network-vif-deleted", "tag": "75859805-bde6-4c9f-97a2-f33dca1a8545"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:09.017798 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-d5751ae1-c50f-4eed-98c9-3600f3e44ded req-588cb25b-644b-4f03-a43d-cd7f172b8623 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:09.018933 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-d5751ae1-c50f-4eed-98c9-3600f3e44ded req-588cb25b-644b-4f03-a43d-cd7f172b8623 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:09.020481 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-d5751ae1-c50f-4eed-98c9-3600f3e44ded req-588cb25b-644b-4f03-a43d-cd7f172b8623 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:09.035671 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-d5751ae1-c50f-4eed-98c9-3600f3e44ded req-588cb25b-644b-4f03-a43d-cd7f172b8623 service nova] Creating event network-vif-deleted:75859805-bde6-4c9f-97a2-f33dca1a8545 for instance 6fb4b6a3-5be8-48da-a564-3bf08b732fa5 on hv-cinder-85426 Aug 24 03:35:09.037318 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-5acd1baf-93b1-42f5-9bb2-c325ffbccef2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:09.040699 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-d5751ae1-c50f-4eed-98c9-3600f3e44ded req-588cb25b-644b-4f03-a43d-cd7f172b8623 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041886 Aug 24 03:35:09.041687 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 280/565] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:35:09.049882 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-5acd1baf-93b1-42f5-9bb2-c325ffbccef2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:09.051478 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-5acd1baf-93b1-42f5-9bb2-c325ffbccef2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:09.052659 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-5acd1baf-93b1-42f5-9bb2-c325ffbccef2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1340 microversion: 2.20 time: 0.099761 Aug 24 03:35:09.053247 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 286/566] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:08 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1340 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:09.087778 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1c300ba9-4ae6-48ab-89c9-851d1db81ac8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:09.091083 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1c300ba9-4ae6-48ab-89c9-851d1db81ac8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:09.097521 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1c300ba9-4ae6-48ab-89c9-851d1db81ac8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:09.098011 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1c300ba9-4ae6-48ab-89c9-851d1db81ac8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:09.098459 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1c300ba9-4ae6-48ab-89c9-851d1db81ac8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:09.099163 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1c300ba9-4ae6-48ab-89c9-851d1db81ac8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:09.099616 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1c300ba9-4ae6-48ab-89c9-851d1db81ac8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:09.100040 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1c300ba9-4ae6-48ab-89c9-851d1db81ac8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:09.129104 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1c300ba9-4ae6-48ab-89c9-851d1db81ac8 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045618 Aug 24 03:35:09.129872 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 281/567] 10.222.0.81 () {58 vars in 1302 bytes} [Wed Aug 24 03:35:09 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:35:09.140477 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-63d32215-0f86-43a0-9051-7a2b76fb4853 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:09.141039 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-63d32215-0f86-43a0-9051-7a2b76fb4853 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:09.146904 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-63d32215-0f86-43a0-9051-7a2b76fb4853 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:09.147402 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-63d32215-0f86-43a0-9051-7a2b76fb4853 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:09.147834 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-63d32215-0f86-43a0-9051-7a2b76fb4853 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:09.148518 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-63d32215-0f86-43a0-9051-7a2b76fb4853 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:09.149010 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-63d32215-0f86-43a0-9051-7a2b76fb4853 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:09.149431 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-63d32215-0f86-43a0-9051-7a2b76fb4853 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:09.271041 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.wsgi [None req-63d32215-0f86-43a0-9051-7a2b76fb4853 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] HTTP exception thrown: Instance 733c5faa-7030-4ad2-9fe5-357ce22b115f is not attached to volume e941ff04-8f46-4fd1-bc02-0b6a7ffdafb3 Aug 24 03:35:09.273642 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-63d32215-0f86-43a0-9051-7a2b76fb4853 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Request method failure captured: Aug 24 03:35:09.273642 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: request: DELETE /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f/os-volume_attachments/e941ff04-8f46-4fd1-bc02-0b6a7ffdafb3 HTTP/1.1 Aug 24 03:35:09.273642 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept: application/json Aug 24 03:35:09.273642 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept-Encoding: identity Aug 24 03:35:09.273642 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Connection: close Aug 24 03:35:09.273642 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Length: 0 Aug 24 03:35:09.273642 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Type: application/json Aug 24 03:35:09.273642 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Host: 10.222.0.81 Aug 24 03:35:09.273642 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Openstack-System-Scope: None Aug 24 03:35:09.273642 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: User-Agent: python-urllib3/1.26.11 Aug 24 03:35:09.273642 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Auth-Token: gAAAAABjBZvfPGXLYbGXVtjZbEpVCj_ushEEfpaDJ3RSBgADDkxADRghzFRrdYz7weVk9w_ECFSfxlnaq12dFnDVN-mvSI83gOHSYMO6fQD4xyVW4ZSlfaBKgvTkhjKl3BgCYaF9fkB0MgJDL5sk--GVuAaDG07fULTjx3LUGLX5FykT1Vs9gF8 Aug 24 03:35:09.273642 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Id: None Aug 24 03:35:09.273642 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Name: None Aug 24 03:35:09.273642 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Identity-Status: Confirmed Aug 24 03:35:09.273642 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Is-Admin-Project: True Aug 24 03:35:09.273642 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Id: default Aug 24 03:35:09.273642 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Name: Default Aug 24 03:35:09.273642 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Id: 60ed59a87fd44afb9064c8eef04b19c1 Aug 24 03:35:09.273642 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Name: tempest-TestMinimumBasicScenario-167380290 Aug 24 03:35:09.273642 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Role: reader,member Aug 24 03:35:09.273642 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Roles: reader,member Aug 24 03:35:09.275069 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/60ed59a87fd44afb9064c8eef04b19c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_60ed59a87fd44afb9064c8eef04b19c1", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/60ed59a87fd44afb9064c8eef04b19c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/60ed59a87fd44afb9064c8eef04b19c1"}]}] Aug 24 03:35:09.275069 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant: tempest-TestMinimumBasicScenario-167380290 Aug 24 03:35:09.275069 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Id: 60ed59a87fd44afb9064c8eef04b19c1 Aug 24 03:35:09.275069 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Name: tempest-TestMinimumBasicScenario-167380290 Aug 24 03:35:09.275069 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User: tempest-TestMinimumBasicScenario-167380290-project Aug 24 03:35:09.275069 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Id: default Aug 24 03:35:09.275069 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Name: Default Aug 24 03:35:09.275069 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Id: 37b485ad806647f595c5b359505f1dd0 Aug 24 03:35:09.275069 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Name: tempest-TestMinimumBasicScenario-167380290-project Aug 24 03:35:09.275069 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: method: > Aug 24 03:35:09.275069 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: exception: Instance 733c5faa-7030-4ad2-9fe5-357ce22b115f is not attached to volume e941ff04-8f46-4fd1-bc02-0b6a7ffdafb3 Aug 24 03:35:09.275749 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: action_args: {'server_id': '733c5faa-7030-4ad2-9fe5-357ce22b115f', 'id': 'e941ff04-8f46-4fd1-bc02-0b6a7ffdafb3'} Aug 24 03:35:09.275749 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:35:09.275749 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:09.275749 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 03:35:09.275749 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 03:35:09.275749 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:35:09.275749 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:35:09.275749 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 03:35:09.275749 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 03:35:09.275749 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e941ff04-8f46-4fd1-bc02-0b6a7ffdafb3. Aug 24 03:35:09.275749 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:35:09.275749 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:09.275749 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:35:09.275749 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:09.275749 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:09.275749 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:09.275749 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:35:09.275749 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:35:09.275749 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:35:09.277845 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:35:09.277845 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 03:35:09.277845 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 03:35:09.277845 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 733c5faa-7030-4ad2-9fe5-357ce22b115f is not attached to volume e941ff04-8f46-4fd1-bc02-0b6a7ffdafb3 Aug 24 03:35:09.277845 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:35:09.277845 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:09.277845 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:35:09.277845 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:09.277845 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:09.277845 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:09.277845 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:35:09.277845 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:35:09.277845 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 733c5faa-7030-4ad2-9fe5-357ce22b115f is not attached to volume e941ff04-8f46-4fd1-bc02-0b6a7ffdafb3 Aug 24 03:35:09.277845 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:35:09.277845 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-63d32215-0f86-43a0-9051-7a2b76fb4853 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Returning 404 to user: Instance 733c5faa-7030-4ad2-9fe5-357ce22b115f is not attached to volume e941ff04-8f46-4fd1-bc02-0b6a7ffdafb3 {{(pid=120709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:35:09.278876 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-63d32215-0f86-43a0-9051-7a2b76fb4853 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "DELETE /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f/os-volume_attachments/e941ff04-8f46-4fd1-bc02-0b6a7ffdafb3" status: 404 len: 154 microversion: 2.1 time: 0.138954 Aug 24 03:35:09.278876 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 287/568] 10.222.0.81 () {58 vars in 1416 bytes} [Wed Aug 24 03:35:09 2022] DELETE /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f/os-volume_attachments/e941ff04-8f46-4fd1-bc02-0b6a7ffdafb3 => generated 154 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:35:09.954347 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2f72218e-2b74-460b-a983-db7ee941535b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:09.954985 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2f72218e-2b74-460b-a983-db7ee941535b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: 6fb4b6a3-5be8-48da-a564-3bf08b732fa5] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:09.963315 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2f72218e-2b74-460b-a983-db7ee941535b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:09.963809 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2f72218e-2b74-460b-a983-db7ee941535b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:09.964250 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2f72218e-2b74-460b-a983-db7ee941535b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:09.965698 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2f72218e-2b74-460b-a983-db7ee941535b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:09.966157 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2f72218e-2b74-460b-a983-db7ee941535b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:09.966584 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2f72218e-2b74-460b-a983-db7ee941535b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:09.984336 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-2f72218e-2b74-460b-a983-db7ee941535b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] HTTP exception thrown: Instance 6fb4b6a3-5be8-48da-a564-3bf08b732fa5 could not be found. Aug 24 03:35:09.986145 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2f72218e-2b74-460b-a983-db7ee941535b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Request method failure captured: Aug 24 03:35:09.986145 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 HTTP/1.1 Aug 24 03:35:09.986145 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 24 03:35:09.986145 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 24 03:35:09.986145 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Connection: close Aug 24 03:35:09.986145 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 24 03:35:09.986145 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 24 03:35:09.986145 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Host: 10.222.0.81 Aug 24 03:35:09.986145 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 24 03:35:09.986145 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.11 Aug 24 03:35:09.986145 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjBZtELohYIAWnqjydeh3nWBVxVzNmFojSvJiXirJze4xCW5UrBoFNDSrYI2MQuwDBgKCF0rIi4_RidefSOe-gruz8glzTk9P0i0YWWK0Ls_tkgBqEsg07AX095VUNsx8SXSrVeXxD-FtuxDYQ-PAYt2BeP7o3wF-sE_NMuIwVCtJS2k0 Aug 24 03:35:09.986145 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 24 03:35:09.986145 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 24 03:35:09.986145 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 24 03:35:09.986145 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 24 03:35:09.986145 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 24 03:35:09.986145 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 24 03:35:09.986145 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Id: 625e6391470e4018a6c502219b3d2b15 Aug 24 03:35:09.986145 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1294945241 Aug 24 03:35:09.986145 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 24 03:35:09.986145 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 24 03:35:09.987411 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/625e6391470e4018a6c502219b3d2b15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_625e6391470e4018a6c502219b3d2b15", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/625e6391470e4018a6c502219b3d2b15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/625e6391470e4018a6c502219b3d2b15"}]}] Aug 24 03:35:09.987411 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1294945241 Aug 24 03:35:09.987411 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 625e6391470e4018a6c502219b3d2b15 Aug 24 03:35:09.987411 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1294945241 Aug 24 03:35:09.987411 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User: tempest-ServerRescueNegativeTestJSON-1294945241-project Aug 24 03:35:09.987411 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 24 03:35:09.987411 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 24 03:35:09.987411 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Id: 33b932f3feb342d889155c3c34407a88 Aug 24 03:35:09.987411 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1294945241-project Aug 24 03:35:09.987411 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: method: > Aug 24 03:35:09.987411 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: exception: Instance 6fb4b6a3-5be8-48da-a564-3bf08b732fa5 could not be found. Aug 24 03:35:09.987411 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: action_args: {'id': '6fb4b6a3-5be8-48da-a564-3bf08b732fa5'} Aug 24 03:35:09.988146 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:35:09.988146 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:09.988146 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:35:09.988146 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:35:09.988146 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:35:09.988146 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:35:09.988146 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:35:09.988146 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:35:09.988146 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:35:09.988146 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:35:09.988146 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fb4b6a3-5be8-48da-a564-3bf08b732fa5 could not be found. Aug 24 03:35:09.988146 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:35:09.988146 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:09.988146 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:35:09.988146 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:09.988146 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:09.988146 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:09.988146 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:35:09.988146 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:35:09.988146 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:35:09.989381 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:35:09.989381 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:35:09.989381 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:35:09.989381 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:35:09.989381 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:35:09.989381 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:35:09.989381 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:35:09.989381 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fb4b6a3-5be8-48da-a564-3bf08b732fa5 could not be found. Aug 24 03:35:09.989381 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:35:09.989381 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:09.989381 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:35:09.989381 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:09.989381 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:09.989381 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:09.989381 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:35:09.989381 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:35:09.989381 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fb4b6a3-5be8-48da-a564-3bf08b732fa5 could not be found. Aug 24 03:35:09.989381 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:35:09.990449 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2f72218e-2b74-460b-a983-db7ee941535b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Returning 404 to user: Instance 6fb4b6a3-5be8-48da-a564-3bf08b732fa5 could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:35:09.990449 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2f72218e-2b74-460b-a983-db7ee941535b tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5" status: 404 len: 111 microversion: 2.1 time: 0.038510 Aug 24 03:35:09.990449 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 282/569] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:09 2022] GET /compute/v2.1/servers/6fb4b6a3-5be8-48da-a564-3bf08b732fa5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:35:09.996263 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-513d42f0-2f0e-4997-90a8-cdd7ed279cea tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:09.997304 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-513d42f0-2f0e-4997-90a8-cdd7ed279cea tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:10.005427 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-513d42f0-2f0e-4997-90a8-cdd7ed279cea tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:10.005922 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-513d42f0-2f0e-4997-90a8-cdd7ed279cea tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:10.006362 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-513d42f0-2f0e-4997-90a8-cdd7ed279cea tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:10.007339 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-513d42f0-2f0e-4997-90a8-cdd7ed279cea tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:10.007789 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-513d42f0-2f0e-4997-90a8-cdd7ed279cea tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:10.008207 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-513d42f0-2f0e-4997-90a8-cdd7ed279cea tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:10.037149 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-513d42f0-2f0e-4997-90a8-cdd7ed279cea tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Going to try to terminate instance {{(pid=120709) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:35:10.075674 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a37a5baa-5f52-4ff3-b439-dd0d46cd2052 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:10.076429 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a37a5baa-5f52-4ff3-b439-dd0d46cd2052 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:10.082756 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a37a5baa-5f52-4ff3-b439-dd0d46cd2052 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:10.083461 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a37a5baa-5f52-4ff3-b439-dd0d46cd2052 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:10.084118 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a37a5baa-5f52-4ff3-b439-dd0d46cd2052 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:10.084826 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a37a5baa-5f52-4ff3-b439-dd0d46cd2052 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:10.085461 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a37a5baa-5f52-4ff3-b439-dd0d46cd2052 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:10.086065 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a37a5baa-5f52-4ff3-b439-dd0d46cd2052 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:10.119121 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-513d42f0-2f0e-4997-90a8-cdd7ed279cea tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 204 len: 0 microversion: 2.1 time: 0.126497 Aug 24 03:35:10.120328 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 288/570] 10.222.0.81 () {58 vars in 1239 bytes} [Wed Aug 24 03:35:09 2022] DELETE /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:35:10.129688 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-4e3fd983-56b8-4292-a816-b871c2b215a6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:10.130387 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-4e3fd983-56b8-4292-a816-b871c2b215a6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:10.136242 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4e3fd983-56b8-4292-a816-b871c2b215a6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:10.137579 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4e3fd983-56b8-4292-a816-b871c2b215a6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:10.138025 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4e3fd983-56b8-4292-a816-b871c2b215a6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:10.138723 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4e3fd983-56b8-4292-a816-b871c2b215a6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:10.139178 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4e3fd983-56b8-4292-a816-b871c2b215a6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:10.139602 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4e3fd983-56b8-4292-a816-b871c2b215a6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:10.290042 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a37a5baa-5f52-4ff3-b439-dd0d46cd2052 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:10.299708 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a37a5baa-5f52-4ff3-b439-dd0d46cd2052 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:10.301299 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a37a5baa-5f52-4ff3-b439-dd0d46cd2052 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:10.302414 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a37a5baa-5f52-4ff3-b439-dd0d46cd2052 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1408 microversion: 2.20 time: 0.230968 Aug 24 03:35:10.302968 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 283/571] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:10 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1408 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:35:10.320814 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-4e3fd983-56b8-4292-a816-b871c2b215a6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:10.330184 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-4e3fd983-56b8-4292-a816-b871c2b215a6 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1522 microversion: 2.1 time: 0.204601 Aug 24 03:35:10.330758 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 289/572] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:10 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:10.437863 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ad54e9d0-ebc3-4041-9c96-30a12d38bb15 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:10.438369 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ad54e9d0-ebc3-4041-9c96-30a12d38bb15 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:10.444738 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ad54e9d0-ebc3-4041-9c96-30a12d38bb15 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:10.445199 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ad54e9d0-ebc3-4041-9c96-30a12d38bb15 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:10.445643 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ad54e9d0-ebc3-4041-9c96-30a12d38bb15 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:10.446347 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ad54e9d0-ebc3-4041-9c96-30a12d38bb15 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:10.446867 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ad54e9d0-ebc3-4041-9c96-30a12d38bb15 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:10.447583 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ad54e9d0-ebc3-4041-9c96-30a12d38bb15 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:10.461997 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-2ce2cad2-e567-4157-b8ce-f9891adee0a6 req-9ed01ca4-6c46-4218-8d13-6502526a145c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4", "tag": "c49bffe3-b213-40d0-a914-6759e188a044"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:10.474017 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-2ce2cad2-e567-4157-b8ce-f9891adee0a6 req-9ed01ca4-6c46-4218-8d13-6502526a145c service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:10.474499 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-2ce2cad2-e567-4157-b8ce-f9891adee0a6 req-9ed01ca4-6c46-4218-8d13-6502526a145c service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:10.474990 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ad54e9d0-ebc3-4041-9c96-30a12d38bb15 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Going to try to terminate instance {{(pid=120708) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:35:10.475101 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-2ce2cad2-e567-4157-b8ce-f9891adee0a6 req-9ed01ca4-6c46-4218-8d13-6502526a145c service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:10.486729 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-2ce2cad2-e567-4157-b8ce-f9891adee0a6 req-9ed01ca4-6c46-4218-8d13-6502526a145c service nova] Creating event network-changed:c49bffe3-b213-40d0-a914-6759e188a044 for instance a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 on hv-cinder-85426 Aug 24 03:35:10.491598 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-2ce2cad2-e567-4157-b8ce-f9891adee0a6 req-9ed01ca4-6c46-4218-8d13-6502526a145c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033365 Aug 24 03:35:10.492196 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 290/573] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:10.551478 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ad54e9d0-ebc3-4041-9c96-30a12d38bb15 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "DELETE /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 204 len: 0 microversion: 2.1 time: 0.117548 Aug 24 03:35:10.552053 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 284/574] 10.222.0.81 () {58 vars in 1239 bytes} [Wed Aug 24 03:35:10 2022] DELETE /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:35:10.561614 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-5cc15786-c33b-4ea2-97f3-c03b1d6943cd tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:10.562410 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-5cc15786-c33b-4ea2-97f3-c03b1d6943cd tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:10.565467 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=4,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:10.569883 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5cc15786-c33b-4ea2-97f3-c03b1d6943cd tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:10.570362 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5cc15786-c33b-4ea2-97f3-c03b1d6943cd tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:10.570796 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5cc15786-c33b-4ea2-97f3-c03b1d6943cd tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:10.571480 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5cc15786-c33b-4ea2-97f3-c03b1d6943cd tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:10.571935 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5cc15786-c33b-4ea2-97f3-c03b1d6943cd tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:10.572355 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5cc15786-c33b-4ea2-97f3-c03b1d6943cd tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:10.754948 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-5cc15786-c33b-4ea2-97f3-c03b1d6943cd tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:10.763236 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-5cc15786-c33b-4ea2-97f3-c03b1d6943cd tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1551 microversion: 2.1 time: 0.206730 Aug 24 03:35:10.763806 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 291/575] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:10 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1551 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:11.326265 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-508af542-e704-45aa-8f8d-708de43487b7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:11.326958 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-508af542-e704-45aa-8f8d-708de43487b7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:11.333382 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-508af542-e704-45aa-8f8d-708de43487b7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:11.333857 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-508af542-e704-45aa-8f8d-708de43487b7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:11.334288 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-508af542-e704-45aa-8f8d-708de43487b7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:11.334966 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-508af542-e704-45aa-8f8d-708de43487b7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:11.335412 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-508af542-e704-45aa-8f8d-708de43487b7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:11.335829 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-508af542-e704-45aa-8f8d-708de43487b7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:11.351327 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-221134aa-69aa-48e7-b69f-88f49ca5bcde tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:11.352005 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-221134aa-69aa-48e7-b69f-88f49ca5bcde tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:11.359052 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-221134aa-69aa-48e7-b69f-88f49ca5bcde tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:11.359539 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-221134aa-69aa-48e7-b69f-88f49ca5bcde tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:11.359983 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-221134aa-69aa-48e7-b69f-88f49ca5bcde tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:11.360682 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-221134aa-69aa-48e7-b69f-88f49ca5bcde tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:11.361170 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-221134aa-69aa-48e7-b69f-88f49ca5bcde tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:11.361629 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-221134aa-69aa-48e7-b69f-88f49ca5bcde tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:11.565659 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-221134aa-69aa-48e7-b69f-88f49ca5bcde tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:11.569643 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-508af542-e704-45aa-8f8d-708de43487b7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:11.573511 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-221134aa-69aa-48e7-b69f-88f49ca5bcde tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1522 microversion: 2.1 time: 0.225979 Aug 24 03:35:11.574624 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 292/576] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:11 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:11.578101 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-508af542-e704-45aa-8f8d-708de43487b7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:11.579537 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-508af542-e704-45aa-8f8d-708de43487b7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:11.580634 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-508af542-e704-45aa-8f8d-708de43487b7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1408 microversion: 2.20 time: 0.258655 Aug 24 03:35:11.581213 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 285/577] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:11 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1408 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:11.786092 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-e5f1dcde-30a5-45a5-ac05-24849fbb5b1d tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:11.786708 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-e5f1dcde-30a5-45a5-ac05-24849fbb5b1d tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:11.792732 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e5f1dcde-30a5-45a5-ac05-24849fbb5b1d tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:11.793248 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e5f1dcde-30a5-45a5-ac05-24849fbb5b1d tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:11.793688 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e5f1dcde-30a5-45a5-ac05-24849fbb5b1d tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:11.794382 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e5f1dcde-30a5-45a5-ac05-24849fbb5b1d tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:11.794837 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e5f1dcde-30a5-45a5-ac05-24849fbb5b1d tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:11.795264 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e5f1dcde-30a5-45a5-ac05-24849fbb5b1d tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:11.922815 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-e5f1dcde-30a5-45a5-ac05-24849fbb5b1d tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:11.930398 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-e5f1dcde-30a5-45a5-ac05-24849fbb5b1d tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1551 microversion: 2.1 time: 0.148132 Aug 24 03:35:11.930952 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 293/578] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:11 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1551 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:12.603145 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-b89a9cc6-5f00-4c5f-9e2e-89a09f896b54 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:12.603751 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-b89a9cc6-5f00-4c5f-9e2e-89a09f896b54 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:12.610687 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b89a9cc6-5f00-4c5f-9e2e-89a09f896b54 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:12.611163 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b89a9cc6-5f00-4c5f-9e2e-89a09f896b54 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:12.611600 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b89a9cc6-5f00-4c5f-9e2e-89a09f896b54 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:12.612285 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b89a9cc6-5f00-4c5f-9e2e-89a09f896b54 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:12.612736 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b89a9cc6-5f00-4c5f-9e2e-89a09f896b54 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:12.613190 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b89a9cc6-5f00-4c5f-9e2e-89a09f896b54 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:12.653341 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-80c5f20a-2367-4a47-ba45-47c13bf1ad50 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:12.653965 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-80c5f20a-2367-4a47-ba45-47c13bf1ad50 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:12.659972 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-80c5f20a-2367-4a47-ba45-47c13bf1ad50 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:12.660456 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-80c5f20a-2367-4a47-ba45-47c13bf1ad50 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:12.660931 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-80c5f20a-2367-4a47-ba45-47c13bf1ad50 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:12.661632 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-80c5f20a-2367-4a47-ba45-47c13bf1ad50 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:12.662093 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-80c5f20a-2367-4a47-ba45-47c13bf1ad50 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:12.662514 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-80c5f20a-2367-4a47-ba45-47c13bf1ad50 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:12.802572 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-b89a9cc6-5f00-4c5f-9e2e-89a09f896b54 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:12.814107 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-b89a9cc6-5f00-4c5f-9e2e-89a09f896b54 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:12.815715 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-b89a9cc6-5f00-4c5f-9e2e-89a09f896b54 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:12.816895 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-b89a9cc6-5f00-4c5f-9e2e-89a09f896b54 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1408 microversion: 2.20 time: 0.217522 Aug 24 03:35:12.817479 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 294/579] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:12 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1408 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:35:12.829583 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-80c5f20a-2367-4a47-ba45-47c13bf1ad50 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:12.837288 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-80c5f20a-2367-4a47-ba45-47c13bf1ad50 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1522 microversion: 2.1 time: 0.245826 Aug 24 03:35:12.837845 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 286/580] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:12 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:12.951529 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-7a02334d-6ec0-46ab-a67f-e9204e91538a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:12.952164 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-7a02334d-6ec0-46ab-a67f-e9204e91538a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:12.958038 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7a02334d-6ec0-46ab-a67f-e9204e91538a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:12.958521 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7a02334d-6ec0-46ab-a67f-e9204e91538a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:12.958957 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7a02334d-6ec0-46ab-a67f-e9204e91538a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:12.959642 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7a02334d-6ec0-46ab-a67f-e9204e91538a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:12.960096 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7a02334d-6ec0-46ab-a67f-e9204e91538a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:12.960516 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7a02334d-6ec0-46ab-a67f-e9204e91538a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:12.965567 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:13.097594 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-7a02334d-6ec0-46ab-a67f-e9204e91538a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:13.106000 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-7a02334d-6ec0-46ab-a67f-e9204e91538a tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1551 microversion: 2.1 time: 0.158704 Aug 24 03:35:13.107166 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 295/581] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:12 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1551 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:13.839661 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f279a07e-fb87-4e58-a3b9-0b586e49413a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:13.840275 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f279a07e-fb87-4e58-a3b9-0b586e49413a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:13.847113 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f279a07e-fb87-4e58-a3b9-0b586e49413a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:13.847600 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f279a07e-fb87-4e58-a3b9-0b586e49413a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:13.848043 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f279a07e-fb87-4e58-a3b9-0b586e49413a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:13.848738 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f279a07e-fb87-4e58-a3b9-0b586e49413a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:13.849215 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f279a07e-fb87-4e58-a3b9-0b586e49413a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:13.849672 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f279a07e-fb87-4e58-a3b9-0b586e49413a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:13.858803 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-4ad2ada7-7734-4de1-b0e4-b48c36f5f826 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:13.859419 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-4ad2ada7-7734-4de1-b0e4-b48c36f5f826 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:13.865741 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4ad2ada7-7734-4de1-b0e4-b48c36f5f826 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:13.866234 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4ad2ada7-7734-4de1-b0e4-b48c36f5f826 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:13.866676 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4ad2ada7-7734-4de1-b0e4-b48c36f5f826 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:13.867372 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4ad2ada7-7734-4de1-b0e4-b48c36f5f826 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:13.867832 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4ad2ada7-7734-4de1-b0e4-b48c36f5f826 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:13.868261 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4ad2ada7-7734-4de1-b0e4-b48c36f5f826 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:14.054352 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f279a07e-fb87-4e58-a3b9-0b586e49413a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:14.059508 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-4ad2ada7-7734-4de1-b0e4-b48c36f5f826 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:14.063392 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f279a07e-fb87-4e58-a3b9-0b586e49413a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:14.064960 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f279a07e-fb87-4e58-a3b9-0b586e49413a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:14.066133 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f279a07e-fb87-4e58-a3b9-0b586e49413a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1408 microversion: 2.20 time: 0.230369 Aug 24 03:35:14.066689 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-4ad2ada7-7734-4de1-b0e4-b48c36f5f826 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1522 microversion: 2.1 time: 0.211734 Aug 24 03:35:14.066807 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 287/582] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:13 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1408 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:14.067444 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 296/583] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:13 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:14.131167 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-82f0e108-f9d5-4209-bd5e-42cfc43f7099 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:14.131784 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-82f0e108-f9d5-4209-bd5e-42cfc43f7099 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:14.138012 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-82f0e108-f9d5-4209-bd5e-42cfc43f7099 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:14.138496 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-82f0e108-f9d5-4209-bd5e-42cfc43f7099 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:14.138938 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-82f0e108-f9d5-4209-bd5e-42cfc43f7099 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:14.139626 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-82f0e108-f9d5-4209-bd5e-42cfc43f7099 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:14.140080 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-82f0e108-f9d5-4209-bd5e-42cfc43f7099 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:14.140505 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-82f0e108-f9d5-4209-bd5e-42cfc43f7099 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:14.266757 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-82f0e108-f9d5-4209-bd5e-42cfc43f7099 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:14.274349 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-82f0e108-f9d5-4209-bd5e-42cfc43f7099 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1551 microversion: 2.1 time: 0.146955 Aug 24 03:35:14.274908 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 288/584] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:14 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1551 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:15.087099 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-d50ef0ec-8113-411e-992d-b4ee4c130553 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:15.087823 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-d50ef0ec-8113-411e-992d-b4ee4c130553 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:15.090029 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-429e3686-23d3-4f71-8677-66a9688b4142 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:15.091801 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-429e3686-23d3-4f71-8677-66a9688b4142 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:15.095474 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d50ef0ec-8113-411e-992d-b4ee4c130553 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:15.095784 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d50ef0ec-8113-411e-992d-b4ee4c130553 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:15.096288 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d50ef0ec-8113-411e-992d-b4ee4c130553 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:15.097089 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d50ef0ec-8113-411e-992d-b4ee4c130553 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:15.097537 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d50ef0ec-8113-411e-992d-b4ee4c130553 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:15.097958 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d50ef0ec-8113-411e-992d-b4ee4c130553 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:15.098479 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-429e3686-23d3-4f71-8677-66a9688b4142 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:15.098961 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-429e3686-23d3-4f71-8677-66a9688b4142 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:15.099397 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-429e3686-23d3-4f71-8677-66a9688b4142 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:15.100082 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-429e3686-23d3-4f71-8677-66a9688b4142 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:15.100532 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-429e3686-23d3-4f71-8677-66a9688b4142 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:15.100979 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-429e3686-23d3-4f71-8677-66a9688b4142 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:15.298675 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-d50ef0ec-8113-411e-992d-b4ee4c130553 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:15.306409 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-429e3686-23d3-4f71-8677-66a9688b4142 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:15.306985 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-d50ef0ec-8113-411e-992d-b4ee4c130553 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1522 microversion: 2.1 time: 0.223746 Aug 24 03:35:15.307558 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 297/585] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:15 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:15.312917 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-b030ab91-dd41-4398-8759-37abf0671da7 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:15.313553 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-b030ab91-dd41-4398-8759-37abf0671da7 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:15.315216 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-429e3686-23d3-4f71-8677-66a9688b4142 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:15.316803 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-429e3686-23d3-4f71-8677-66a9688b4142 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:15.317997 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-429e3686-23d3-4f71-8677-66a9688b4142 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1408 microversion: 2.20 time: 0.231929 Aug 24 03:35:15.318705 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 289/586] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:15 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1408 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:35:15.319609 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b030ab91-dd41-4398-8759-37abf0671da7 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:15.320216 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b030ab91-dd41-4398-8759-37abf0671da7 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:15.320726 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b030ab91-dd41-4398-8759-37abf0671da7 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:15.321456 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b030ab91-dd41-4398-8759-37abf0671da7 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:15.321910 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b030ab91-dd41-4398-8759-37abf0671da7 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:15.322339 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b030ab91-dd41-4398-8759-37abf0671da7 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:15.470430 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-b030ab91-dd41-4398-8759-37abf0671da7 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:15.478728 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-b030ab91-dd41-4398-8759-37abf0671da7 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1551 microversion: 2.1 time: 0.170104 Aug 24 03:35:15.479509 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 298/587] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:15 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1551 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:15.963394 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-5ab78c34-18ea-4fdc-b0a2-a609c0ac4c25 req-862b53d7-1b38-411c-b2db-be648ecfb5a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "733c5faa-7030-4ad2-9fe5-357ce22b115f", "name": "network-vif-deleted", "tag": "925d9bc5-c59a-44c2-9c0d-39c5bc93381b"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:15.975739 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-5ab78c34-18ea-4fdc-b0a2-a609c0ac4c25 req-862b53d7-1b38-411c-b2db-be648ecfb5a1 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:15.976318 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-5ab78c34-18ea-4fdc-b0a2-a609c0ac4c25 req-862b53d7-1b38-411c-b2db-be648ecfb5a1 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:15.976930 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-5ab78c34-18ea-4fdc-b0a2-a609c0ac4c25 req-862b53d7-1b38-411c-b2db-be648ecfb5a1 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:15.994534 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-5ab78c34-18ea-4fdc-b0a2-a609c0ac4c25 req-862b53d7-1b38-411c-b2db-be648ecfb5a1 service nova] Creating event network-vif-deleted:925d9bc5-c59a-44c2-9c0d-39c5bc93381b for instance 733c5faa-7030-4ad2-9fe5-357ce22b115f on hv-cinder-85426 Aug 24 03:35:16.001085 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-5ab78c34-18ea-4fdc-b0a2-a609c0ac4c25 req-862b53d7-1b38-411c-b2db-be648ecfb5a1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041810 Aug 24 03:35:16.002058 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 290/588] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:16.328724 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-8c3b719a-6dcf-4d74-98fc-10c3f1b8aead tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:16.329365 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-8c3b719a-6dcf-4d74-98fc-10c3f1b8aead tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:16.341250 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0026f245-2584-444f-840e-c491c0298716 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:16.341961 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0026f245-2584-444f-840e-c491c0298716 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:16.347707 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8c3b719a-6dcf-4d74-98fc-10c3f1b8aead tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:16.350769 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8c3b719a-6dcf-4d74-98fc-10c3f1b8aead tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:16.350891 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8c3b719a-6dcf-4d74-98fc-10c3f1b8aead tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:16.353349 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0026f245-2584-444f-840e-c491c0298716 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:16.353839 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0026f245-2584-444f-840e-c491c0298716 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:16.354273 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0026f245-2584-444f-840e-c491c0298716 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:16.354974 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0026f245-2584-444f-840e-c491c0298716 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:16.355426 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0026f245-2584-444f-840e-c491c0298716 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:16.356381 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0026f245-2584-444f-840e-c491c0298716 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:16.360005 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8c3b719a-6dcf-4d74-98fc-10c3f1b8aead tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:16.360750 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8c3b719a-6dcf-4d74-98fc-10c3f1b8aead tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:16.361341 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8c3b719a-6dcf-4d74-98fc-10c3f1b8aead tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:16.443694 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-8c3b719a-6dcf-4d74-98fc-10c3f1b8aead tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:16.453845 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-8c3b719a-6dcf-4d74-98fc-10c3f1b8aead tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1480 microversion: 2.1 time: 0.129585 Aug 24 03:35:16.455227 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 299/589] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:16 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1480 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:16.502270 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-905f794e-4eaa-4c05-8926-c0456c360a43 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:16.502877 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-905f794e-4eaa-4c05-8926-c0456c360a43 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:16.513040 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-905f794e-4eaa-4c05-8926-c0456c360a43 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:16.513559 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-905f794e-4eaa-4c05-8926-c0456c360a43 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:16.514007 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-905f794e-4eaa-4c05-8926-c0456c360a43 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:16.514749 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-905f794e-4eaa-4c05-8926-c0456c360a43 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:16.515209 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-905f794e-4eaa-4c05-8926-c0456c360a43 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:16.515640 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-905f794e-4eaa-4c05-8926-c0456c360a43 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:16.565893 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-905f794e-4eaa-4c05-8926-c0456c360a43 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:16.566677 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-905f794e-4eaa-4c05-8926-c0456c360a43 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:16.567272 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-905f794e-4eaa-4c05-8926-c0456c360a43 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:16.567899 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.objects.instance [None req-905f794e-4eaa-4c05-8926-c0456c360a43 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lazy-loading 'fault' on Instance uuid 733c5faa-7030-4ad2-9fe5-357ce22b115f {{(pid=120709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:35:16.579467 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=2 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:16.601223 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=6 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:16.624025 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-905f794e-4eaa-4c05-8926-c0456c360a43 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b485ad806647f595c5b359505f1dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ed59a87fd44afb9064c8eef04b19c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:16.632945 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-905f794e-4eaa-4c05-8926-c0456c360a43 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 200 len: 1347 microversion: 2.1 time: 0.134839 Aug 24 03:35:16.644888 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 300/590] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:16 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 1347 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:16.644888 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-279323f3-c208-4563-84e3-17b932ff8d2e req-23f3fb10-f89f-42ed-a72a-bd595e3bb8fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a844487d-f9fc-4452-843d-d6ac2efb35d6", "name": "network-vif-deleted", "tag": "96ac11e6-aaa8-4961-9e5b-62c81b5e9607"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:16.649494 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-279323f3-c208-4563-84e3-17b932ff8d2e req-23f3fb10-f89f-42ed-a72a-bd595e3bb8fb service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:16.650108 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-279323f3-c208-4563-84e3-17b932ff8d2e req-23f3fb10-f89f-42ed-a72a-bd595e3bb8fb service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:16.650550 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-279323f3-c208-4563-84e3-17b932ff8d2e req-23f3fb10-f89f-42ed-a72a-bd595e3bb8fb service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:16.659612 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0026f245-2584-444f-840e-c491c0298716 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:16.664943 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-279323f3-c208-4563-84e3-17b932ff8d2e req-23f3fb10-f89f-42ed-a72a-bd595e3bb8fb service nova] Creating event network-vif-deleted:96ac11e6-aaa8-4961-9e5b-62c81b5e9607 for instance a844487d-f9fc-4452-843d-d6ac2efb35d6 on hv-cinder-85426 Aug 24 03:35:16.671352 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0026f245-2584-444f-840e-c491c0298716 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:16.671967 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-279323f3-c208-4563-84e3-17b932ff8d2e req-23f3fb10-f89f-42ed-a72a-bd595e3bb8fb service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036826 Aug 24 03:35:16.673146 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 301/591] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:16.673787 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0026f245-2584-444f-840e-c491c0298716 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:16.674988 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0026f245-2584-444f-840e-c491c0298716 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1408 microversion: 2.20 time: 0.338890 Aug 24 03:35:16.675613 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 291/592] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:16 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1408 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:17.473280 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell0:SELECT=6 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:17.478539 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-d30c6859-6b05-44f0-91c5-7c2eafe9f6c4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:17.479232 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-d30c6859-6b05-44f0-91c5-7c2eafe9f6c4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:17.486128 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d30c6859-6b05-44f0-91c5-7c2eafe9f6c4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:17.486607 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d30c6859-6b05-44f0-91c5-7c2eafe9f6c4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:17.487039 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d30c6859-6b05-44f0-91c5-7c2eafe9f6c4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:17.487726 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d30c6859-6b05-44f0-91c5-7c2eafe9f6c4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:17.488174 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d30c6859-6b05-44f0-91c5-7c2eafe9f6c4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:17.488595 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d30c6859-6b05-44f0-91c5-7c2eafe9f6c4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:17.519551 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d30c6859-6b05-44f0-91c5-7c2eafe9f6c4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:17.520020 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d30c6859-6b05-44f0-91c5-7c2eafe9f6c4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:17.520448 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d30c6859-6b05-44f0-91c5-7c2eafe9f6c4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:17.520915 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.objects.instance [None req-d30c6859-6b05-44f0-91c5-7c2eafe9f6c4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lazy-loading 'fault' on Instance uuid a844487d-f9fc-4452-843d-d6ac2efb35d6 {{(pid=120709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:35:17.563418 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-d30c6859-6b05-44f0-91c5-7c2eafe9f6c4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b932f3feb342d889155c3c34407a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625e6391470e4018a6c502219b3d2b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:17.570884 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-d30c6859-6b05-44f0-91c5-7c2eafe9f6c4 tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 200 len: 1312 microversion: 2.1 time: 0.098576 Aug 24 03:35:17.571432 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 302/593] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:17 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:17.656198 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b78f2b73-0f8e-4215-aff0-00040dcbd6f5 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:17.656847 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-b78f2b73-0f8e-4215-aff0-00040dcbd6f5 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] [instance: 733c5faa-7030-4ad2-9fe5-357ce22b115f] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:17.663327 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b78f2b73-0f8e-4215-aff0-00040dcbd6f5 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:17.663812 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b78f2b73-0f8e-4215-aff0-00040dcbd6f5 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:17.664249 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b78f2b73-0f8e-4215-aff0-00040dcbd6f5 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:17.665004 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b78f2b73-0f8e-4215-aff0-00040dcbd6f5 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:17.665465 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b78f2b73-0f8e-4215-aff0-00040dcbd6f5 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:17.665896 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b78f2b73-0f8e-4215-aff0-00040dcbd6f5 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:17.680078 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-b78f2b73-0f8e-4215-aff0-00040dcbd6f5 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] HTTP exception thrown: Instance 733c5faa-7030-4ad2-9fe5-357ce22b115f could not be found. Aug 24 03:35:17.681871 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b78f2b73-0f8e-4215-aff0-00040dcbd6f5 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Request method failure captured: Aug 24 03:35:17.681871 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f HTTP/1.1 Aug 24 03:35:17.681871 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 24 03:35:17.681871 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 24 03:35:17.681871 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Connection: close Aug 24 03:35:17.681871 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 24 03:35:17.681871 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 24 03:35:17.681871 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Host: 10.222.0.81 Aug 24 03:35:17.681871 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 24 03:35:17.681871 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.11 Aug 24 03:35:17.681871 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjBZvfPGXLYbGXVtjZbEpVCj_ushEEfpaDJ3RSBgADDkxADRghzFRrdYz7weVk9w_ECFSfxlnaq12dFnDVN-mvSI83gOHSYMO6fQD4xyVW4ZSlfaBKgvTkhjKl3BgCYaF9fkB0MgJDL5sk--GVuAaDG07fULTjx3LUGLX5FykT1Vs9gF8 Aug 24 03:35:17.681871 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 24 03:35:17.681871 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 24 03:35:17.681871 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 24 03:35:17.681871 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 24 03:35:17.681871 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 24 03:35:17.681871 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 24 03:35:17.681871 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Id: 60ed59a87fd44afb9064c8eef04b19c1 Aug 24 03:35:17.681871 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-TestMinimumBasicScenario-167380290 Aug 24 03:35:17.681871 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 24 03:35:17.681871 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 24 03:35:17.683321 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/60ed59a87fd44afb9064c8eef04b19c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_60ed59a87fd44afb9064c8eef04b19c1", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/60ed59a87fd44afb9064c8eef04b19c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/60ed59a87fd44afb9064c8eef04b19c1"}]}] Aug 24 03:35:17.683321 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-TestMinimumBasicScenario-167380290 Aug 24 03:35:17.683321 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 60ed59a87fd44afb9064c8eef04b19c1 Aug 24 03:35:17.683321 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-TestMinimumBasicScenario-167380290 Aug 24 03:35:17.683321 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User: tempest-TestMinimumBasicScenario-167380290-project Aug 24 03:35:17.683321 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 24 03:35:17.683321 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 24 03:35:17.683321 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Id: 37b485ad806647f595c5b359505f1dd0 Aug 24 03:35:17.683321 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-TestMinimumBasicScenario-167380290-project Aug 24 03:35:17.683321 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: method: > Aug 24 03:35:17.683321 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: exception: Instance 733c5faa-7030-4ad2-9fe5-357ce22b115f could not be found. Aug 24 03:35:17.683321 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: action_args: {'id': '733c5faa-7030-4ad2-9fe5-357ce22b115f'} Aug 24 03:35:17.684179 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:35:17.684179 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:17.684179 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:35:17.684179 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:35:17.684179 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:35:17.684179 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:35:17.684179 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:35:17.684179 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:35:17.684179 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:35:17.684179 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:35:17.684179 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 733c5faa-7030-4ad2-9fe5-357ce22b115f could not be found. Aug 24 03:35:17.684179 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:35:17.684179 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:17.684179 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:35:17.684179 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:17.684179 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:17.684179 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:17.684179 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:35:17.684179 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:35:17.684179 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:35:17.685432 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:35:17.685432 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:35:17.685432 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:35:17.685432 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:35:17.685432 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:35:17.685432 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:35:17.685432 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:35:17.685432 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 733c5faa-7030-4ad2-9fe5-357ce22b115f could not be found. Aug 24 03:35:17.685432 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:35:17.685432 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:17.685432 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:35:17.685432 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:17.685432 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:17.685432 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:17.685432 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:35:17.685432 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:35:17.685432 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 733c5faa-7030-4ad2-9fe5-357ce22b115f could not be found. Aug 24 03:35:17.685432 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:35:17.686438 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b78f2b73-0f8e-4215-aff0-00040dcbd6f5 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Returning 404 to user: Instance 733c5faa-7030-4ad2-9fe5-357ce22b115f could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:35:17.686438 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-b78f2b73-0f8e-4215-aff0-00040dcbd6f5 tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f" status: 404 len: 111 microversion: 2.1 time: 0.031822 Aug 24 03:35:17.686438 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 292/594] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:17 2022] GET /compute/v2.1/servers/733c5faa-7030-4ad2-9fe5-357ce22b115f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:35:17.694082 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-d287573b-b74b-4dfd-a727-4a55408ade2c tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] Calling method '.version_select at 0x7f942f30ac10>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:17.697455 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1a47afd2-a82f-4acc-a803-27d6c887baa1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:17.698632 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1a47afd2-a82f-4acc-a803-27d6c887baa1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:17.705800 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1a47afd2-a82f-4acc-a803-27d6c887baa1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:17.707693 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1a47afd2-a82f-4acc-a803-27d6c887baa1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:17.707693 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1a47afd2-a82f-4acc-a803-27d6c887baa1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:17.707693 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1a47afd2-a82f-4acc-a803-27d6c887baa1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:17.708120 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1a47afd2-a82f-4acc-a803-27d6c887baa1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:17.708865 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1a47afd2-a82f-4acc-a803-27d6c887baa1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:17.714326 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:17.716423 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-d287573b-b74b-4dfd-a727-4a55408ade2c tempest-TestMinimumBasicScenario-167380290 tempest-TestMinimumBasicScenario-167380290-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-977926552" status: 202 len: 0 microversion: 2.1 time: 0.027599 Aug 24 03:35:17.717283 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 303/595] 10.222.0.81 () {58 vars in 1269 bytes} [Wed Aug 24 03:35:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-977926552 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:35:17.867874 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1a47afd2-a82f-4acc-a803-27d6c887baa1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:17.876690 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1a47afd2-a82f-4acc-a803-27d6c887baa1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:17.878225 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1a47afd2-a82f-4acc-a803-27d6c887baa1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:17.879313 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1a47afd2-a82f-4acc-a803-27d6c887baa1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1408 microversion: 2.20 time: 0.186030 Aug 24 03:35:17.879863 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 293/596] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:17 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:35:18.593300 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-be029589-357b-41f4-8f96-defd869c83cf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:18.594167 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-be029589-357b-41f4-8f96-defd869c83cf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] [instance: a844487d-f9fc-4452-843d-d6ac2efb35d6] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:18.600022 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-be029589-357b-41f4-8f96-defd869c83cf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:18.600501 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-be029589-357b-41f4-8f96-defd869c83cf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:18.600967 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-be029589-357b-41f4-8f96-defd869c83cf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:18.601684 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-be029589-357b-41f4-8f96-defd869c83cf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:18.602133 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-be029589-357b-41f4-8f96-defd869c83cf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:18.602608 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-be029589-357b-41f4-8f96-defd869c83cf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:18.616179 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.wsgi [None req-be029589-357b-41f4-8f96-defd869c83cf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] HTTP exception thrown: Instance a844487d-f9fc-4452-843d-d6ac2efb35d6 could not be found. Aug 24 03:35:18.617832 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-be029589-357b-41f4-8f96-defd869c83cf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Request method failure captured: Aug 24 03:35:18.617832 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: request: GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 HTTP/1.1 Aug 24 03:35:18.617832 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept: application/json Aug 24 03:35:18.617832 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept-Encoding: identity Aug 24 03:35:18.617832 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Connection: close Aug 24 03:35:18.617832 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Length: 0 Aug 24 03:35:18.617832 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Type: application/json Aug 24 03:35:18.617832 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Host: 10.222.0.81 Aug 24 03:35:18.617832 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Openstack-System-Scope: None Aug 24 03:35:18.617832 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: User-Agent: python-urllib3/1.26.11 Aug 24 03:35:18.617832 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Auth-Token: gAAAAABjBZtELohYIAWnqjydeh3nWBVxVzNmFojSvJiXirJze4xCW5UrBoFNDSrYI2MQuwDBgKCF0rIi4_RidefSOe-gruz8glzTk9P0i0YWWK0Ls_tkgBqEsg07AX095VUNsx8SXSrVeXxD-FtuxDYQ-PAYt2BeP7o3wF-sE_NMuIwVCtJS2k0 Aug 24 03:35:18.617832 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Id: None Aug 24 03:35:18.617832 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Name: None Aug 24 03:35:18.617832 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Identity-Status: Confirmed Aug 24 03:35:18.617832 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Is-Admin-Project: True Aug 24 03:35:18.617832 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Id: default Aug 24 03:35:18.617832 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Name: Default Aug 24 03:35:18.617832 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Id: 625e6391470e4018a6c502219b3d2b15 Aug 24 03:35:18.617832 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1294945241 Aug 24 03:35:18.617832 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Role: reader,member Aug 24 03:35:18.617832 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Roles: reader,member Aug 24 03:35:18.619373 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/625e6391470e4018a6c502219b3d2b15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_625e6391470e4018a6c502219b3d2b15", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/625e6391470e4018a6c502219b3d2b15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/625e6391470e4018a6c502219b3d2b15"}]}] Aug 24 03:35:18.619373 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1294945241 Aug 24 03:35:18.619373 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Id: 625e6391470e4018a6c502219b3d2b15 Aug 24 03:35:18.619373 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1294945241 Aug 24 03:35:18.619373 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User: tempest-ServerRescueNegativeTestJSON-1294945241-project Aug 24 03:35:18.619373 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Id: default Aug 24 03:35:18.619373 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Name: Default Aug 24 03:35:18.619373 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Id: 33b932f3feb342d889155c3c34407a88 Aug 24 03:35:18.619373 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1294945241-project Aug 24 03:35:18.619373 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: method: > Aug 24 03:35:18.619373 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: exception: Instance a844487d-f9fc-4452-843d-d6ac2efb35d6 could not be found. Aug 24 03:35:18.619373 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: action_args: {'id': 'a844487d-f9fc-4452-843d-d6ac2efb35d6'} Aug 24 03:35:18.620165 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:35:18.620165 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:18.620165 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:35:18.620165 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:35:18.620165 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:35:18.620165 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:35:18.620165 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:35:18.620165 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:35:18.620165 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:35:18.620165 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:35:18.620165 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a844487d-f9fc-4452-843d-d6ac2efb35d6 could not be found. Aug 24 03:35:18.620165 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:35:18.620165 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:18.620165 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:35:18.620165 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:18.620165 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:18.620165 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:18.620165 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:35:18.620165 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:35:18.620165 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:35:18.622264 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:35:18.622264 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:35:18.622264 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:35:18.622264 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:35:18.622264 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:35:18.622264 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:35:18.622264 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:35:18.622264 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a844487d-f9fc-4452-843d-d6ac2efb35d6 could not be found. Aug 24 03:35:18.622264 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:35:18.622264 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:18.622264 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:35:18.622264 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:18.622264 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:18.622264 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:18.622264 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:35:18.622264 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:35:18.622264 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a844487d-f9fc-4452-843d-d6ac2efb35d6 could not be found. Aug 24 03:35:18.622264 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:35:18.623522 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-be029589-357b-41f4-8f96-defd869c83cf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] Returning 404 to user: Instance a844487d-f9fc-4452-843d-d6ac2efb35d6 could not be found. {{(pid=120709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:35:18.623522 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-be029589-357b-41f4-8f96-defd869c83cf tempest-ServerRescueNegativeTestJSON-1294945241 tempest-ServerRescueNegativeTestJSON-1294945241-project] 10.222.0.81 "GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6" status: 404 len: 111 microversion: 2.1 time: 0.030499 Aug 24 03:35:18.623522 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 304/597] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:18 2022] GET /compute/v2.1/servers/a844487d-f9fc-4452-843d-d6ac2efb35d6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:35:18.913717 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c16607f2-93bf-470f-a148-6a06e19955fa tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:18.914336 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c16607f2-93bf-470f-a148-6a06e19955fa tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:18.918660 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:18.923297 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c16607f2-93bf-470f-a148-6a06e19955fa tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:18.923797 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c16607f2-93bf-470f-a148-6a06e19955fa tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:18.924238 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c16607f2-93bf-470f-a148-6a06e19955fa tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:18.924992 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c16607f2-93bf-470f-a148-6a06e19955fa tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:18.925446 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c16607f2-93bf-470f-a148-6a06e19955fa tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:18.925871 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c16607f2-93bf-470f-a148-6a06e19955fa tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:19.284228 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c16607f2-93bf-470f-a148-6a06e19955fa tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:19.294193 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c16607f2-93bf-470f-a148-6a06e19955fa tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:19.300847 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c16607f2-93bf-470f-a148-6a06e19955fa tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:19.302396 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c16607f2-93bf-470f-a148-6a06e19955fa tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1408 microversion: 2.20 time: 0.398041 Aug 24 03:35:19.303274 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 294/598] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:18 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1408 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:20.328909 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-1a28528b-3cc9-416a-9134-af07d93c734a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:20.329527 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-1a28528b-3cc9-416a-9134-af07d93c734a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:20.336363 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1a28528b-3cc9-416a-9134-af07d93c734a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:20.342329 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1a28528b-3cc9-416a-9134-af07d93c734a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:20.355882 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1a28528b-3cc9-416a-9134-af07d93c734a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:20.357064 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1a28528b-3cc9-416a-9134-af07d93c734a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:20.358431 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1a28528b-3cc9-416a-9134-af07d93c734a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:20.359100 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1a28528b-3cc9-416a-9134-af07d93c734a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:20.618451 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-1a28528b-3cc9-416a-9134-af07d93c734a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:20.632049 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-1a28528b-3cc9-416a-9134-af07d93c734a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:20.633938 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-1a28528b-3cc9-416a-9134-af07d93c734a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:20.635500 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-1a28528b-3cc9-416a-9134-af07d93c734a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1408 microversion: 2.20 time: 0.313617 Aug 24 03:35:20.636529 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 305/599] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:20 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1408 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:21.659258 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-5a82e455-53ed-4965-9edf-2adffc0735ab tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:21.659877 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-5a82e455-53ed-4965-9edf-2adffc0735ab tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:21.666495 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5a82e455-53ed-4965-9edf-2adffc0735ab tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:21.667217 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5a82e455-53ed-4965-9edf-2adffc0735ab tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:21.668619 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5a82e455-53ed-4965-9edf-2adffc0735ab tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:21.670442 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5a82e455-53ed-4965-9edf-2adffc0735ab tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:21.678256 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5a82e455-53ed-4965-9edf-2adffc0735ab tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:21.678256 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5a82e455-53ed-4965-9edf-2adffc0735ab tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:21.912686 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-5a82e455-53ed-4965-9edf-2adffc0735ab tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:21.930644 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-5a82e455-53ed-4965-9edf-2adffc0735ab tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:21.932594 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-5a82e455-53ed-4965-9edf-2adffc0735ab tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:21.934605 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-5a82e455-53ed-4965-9edf-2adffc0735ab tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1408 microversion: 2.20 time: 0.278619 Aug 24 03:35:21.935760 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 295/600] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:21 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1408 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:21.986124 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-15460170-c9a3-4897-8175-136ef06d67a0 req-63e00df4-9f80-4152-af97-2814fea1b5d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4", "name": "network-vif-plugged", "status": "completed", "tag": "c49bffe3-b213-40d0-a914-6759e188a044"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:22.003962 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-15460170-c9a3-4897-8175-136ef06d67a0 req-63e00df4-9f80-4152-af97-2814fea1b5d0 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:22.005332 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-15460170-c9a3-4897-8175-136ef06d67a0 req-63e00df4-9f80-4152-af97-2814fea1b5d0 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:22.006204 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-15460170-c9a3-4897-8175-136ef06d67a0 req-63e00df4-9f80-4152-af97-2814fea1b5d0 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:22.022931 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-15460170-c9a3-4897-8175-136ef06d67a0 req-63e00df4-9f80-4152-af97-2814fea1b5d0 service nova] Creating event network-vif-plugged:c49bffe3-b213-40d0-a914-6759e188a044 for instance a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 on hv-cinder-85426 Aug 24 03:35:22.030197 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-15460170-c9a3-4897-8175-136ef06d67a0 req-63e00df4-9f80-4152-af97-2814fea1b5d0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055300 Aug 24 03:35:22.031007 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 306/601] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:35:22.959648 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-fe030cb1-7216-4458-953e-1b05fdcf3343 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:22.960394 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-fe030cb1-7216-4458-953e-1b05fdcf3343 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:22.967663 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fe030cb1-7216-4458-953e-1b05fdcf3343 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:22.968159 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fe030cb1-7216-4458-953e-1b05fdcf3343 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:22.968900 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fe030cb1-7216-4458-953e-1b05fdcf3343 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:22.969808 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fe030cb1-7216-4458-953e-1b05fdcf3343 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:22.970261 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fe030cb1-7216-4458-953e-1b05fdcf3343 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:22.970862 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fe030cb1-7216-4458-953e-1b05fdcf3343 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:23.201837 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-fe030cb1-7216-4458-953e-1b05fdcf3343 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:23.210226 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-fe030cb1-7216-4458-953e-1b05fdcf3343 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:23.211729 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-fe030cb1-7216-4458-953e-1b05fdcf3343 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:23.212859 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-fe030cb1-7216-4458-953e-1b05fdcf3343 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1408 microversion: 2.20 time: 0.257159 Aug 24 03:35:23.213857 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 296/602] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:22 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1408 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:23.624559 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-f6602bd3-4eb2-4f89-9697-ab2eb1bae166 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:23.625751 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-f6602bd3-4eb2-4f89-9697-ab2eb1bae166 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: add1236d-0d50-4a63-8e61-9046f9d8b42d] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:23.633415 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f6602bd3-4eb2-4f89-9697-ab2eb1bae166 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:23.633913 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f6602bd3-4eb2-4f89-9697-ab2eb1bae166 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:23.634347 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f6602bd3-4eb2-4f89-9697-ab2eb1bae166 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:23.635102 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f6602bd3-4eb2-4f89-9697-ab2eb1bae166 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:23.635735 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f6602bd3-4eb2-4f89-9697-ab2eb1bae166 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:23.636156 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f6602bd3-4eb2-4f89-9697-ab2eb1bae166 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:23.666352 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-f6602bd3-4eb2-4f89-9697-ab2eb1bae166 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d/ips" status: 200 len: 145 microversion: 2.1 time: 0.294000 Aug 24 03:35:23.668167 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 307/603] 10.222.0.81 () {58 vars in 1248 bytes} [Wed Aug 24 03:35:23 2022] GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d/ips => generated 145 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:24.236944 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4577ca82-faa9-41d7-b55f-ec45f95f0541 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:24.238122 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-4577ca82-faa9-41d7-b55f-ec45f95f0541 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:24.244485 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4577ca82-faa9-41d7-b55f-ec45f95f0541 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:24.245195 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4577ca82-faa9-41d7-b55f-ec45f95f0541 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:24.245847 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4577ca82-faa9-41d7-b55f-ec45f95f0541 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:24.247004 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4577ca82-faa9-41d7-b55f-ec45f95f0541 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:24.247603 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4577ca82-faa9-41d7-b55f-ec45f95f0541 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:24.248176 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4577ca82-faa9-41d7-b55f-ec45f95f0541 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:24.412315 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4577ca82-faa9-41d7-b55f-ec45f95f0541 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:24.421586 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4577ca82-faa9-41d7-b55f-ec45f95f0541 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:24.423689 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4577ca82-faa9-41d7-b55f-ec45f95f0541 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:24.425169 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4577ca82-faa9-41d7-b55f-ec45f95f0541 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1601 microversion: 2.20 time: 0.192783 Aug 24 03:35:24.441125 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 297/604] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:35:24 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1601 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:35:24.456612 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-171fc254-5cf8-4482-8f7b-71269c901931 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:24.457643 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-171fc254-5cf8-4482-8f7b-71269c901931 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:24.470769 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-171fc254-5cf8-4482-8f7b-71269c901931 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:24.471657 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-171fc254-5cf8-4482-8f7b-71269c901931 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:24.475107 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-171fc254-5cf8-4482-8f7b-71269c901931 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:24.476636 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-171fc254-5cf8-4482-8f7b-71269c901931 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:24.477659 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-171fc254-5cf8-4482-8f7b-71269c901931 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:24.478395 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-171fc254-5cf8-4482-8f7b-71269c901931 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:24.577267 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-171fc254-5cf8-4482-8f7b-71269c901931 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.133367 Aug 24 03:35:24.578452 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 308/605] 10.222.0.81 () {60 vars in 1316 bytes} [Wed Aug 24 03:35:24 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4/os-interface => generated 285 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:35:25.135670 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-30ad0be9-fd50-42c3-a38d-fb4947efa8f4 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65f14f66-ffbe-45d6-a29c-35bfc9a8b155"}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:25.141940 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-30ad0be9-fd50-42c3-a38d-fb4947efa8f4 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: add1236d-0d50-4a63-8e61-9046f9d8b42d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:25.159453 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-30ad0be9-fd50-42c3-a38d-fb4947efa8f4 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:25.160020 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-30ad0be9-fd50-42c3-a38d-fb4947efa8f4 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:25.160472 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-30ad0be9-fd50-42c3-a38d-fb4947efa8f4 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:25.161407 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-30ad0be9-fd50-42c3-a38d-fb4947efa8f4 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:25.161866 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-30ad0be9-fd50-42c3-a38d-fb4947efa8f4 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:25.162395 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-30ad0be9-fd50-42c3-a38d-fb4947efa8f4 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:25.570170 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-30ad0be9-fd50-42c3-a38d-fb4947efa8f4 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "POST /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.439100 Aug 24 03:35:25.601881 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 298/606] 10.222.0.81 () {60 vars in 1323 bytes} [Wed Aug 24 03:35:25 2022] POST /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d/os-volume_attachments => generated 194 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:25.867443 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-7c3b4eb9-6bfb-4246-ad20-9a60a54eb158 req-1cc1f0bb-6449-4946-8016-1e319a3e4a87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4", "tag": "c49bffe3-b213-40d0-a914-6759e188a044"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:25.882172 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-7c3b4eb9-6bfb-4246-ad20-9a60a54eb158 req-1cc1f0bb-6449-4946-8016-1e319a3e4a87 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:25.882654 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-7c3b4eb9-6bfb-4246-ad20-9a60a54eb158 req-1cc1f0bb-6449-4946-8016-1e319a3e4a87 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:25.883278 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-7c3b4eb9-6bfb-4246-ad20-9a60a54eb158 req-1cc1f0bb-6449-4946-8016-1e319a3e4a87 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:25.899635 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-7c3b4eb9-6bfb-4246-ad20-9a60a54eb158 req-1cc1f0bb-6449-4946-8016-1e319a3e4a87 service nova] Creating event network-changed:c49bffe3-b213-40d0-a914-6759e188a044 for instance a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 on hv-cinder-85426 Aug 24 03:35:25.913205 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-7c3b4eb9-6bfb-4246-ad20-9a60a54eb158 req-1cc1f0bb-6449-4946-8016-1e319a3e4a87 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051854 Aug 24 03:35:25.914187 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 309/607] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:33.303161 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2da6f9ab-3dc9-46c7-b8c9-0598e460c0a5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:33.306545 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2da6f9ab-3dc9-46c7-b8c9-0598e460c0a5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: add1236d-0d50-4a63-8e61-9046f9d8b42d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:33.313437 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2da6f9ab-3dc9-46c7-b8c9-0598e460c0a5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:33.314091 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2da6f9ab-3dc9-46c7-b8c9-0598e460c0a5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:33.314812 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2da6f9ab-3dc9-46c7-b8c9-0598e460c0a5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:33.315588 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2da6f9ab-3dc9-46c7-b8c9-0598e460c0a5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:33.316133 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2da6f9ab-3dc9-46c7-b8c9-0598e460c0a5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:33.316920 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2da6f9ab-3dc9-46c7-b8c9-0598e460c0a5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:33.349494 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2da6f9ab-3dc9-46c7-b8c9-0598e460c0a5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052150 Aug 24 03:35:33.350039 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 299/608] 10.222.0.81 () {58 vars in 1302 bytes} [Wed Aug 24 03:35:33 2022] GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:33.362907 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-87930bb1-2851-4aa0-b1f6-b9f732fde3e3 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:33.363541 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-87930bb1-2851-4aa0-b1f6-b9f732fde3e3 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: add1236d-0d50-4a63-8e61-9046f9d8b42d] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:33.369845 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-87930bb1-2851-4aa0-b1f6-b9f732fde3e3 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:33.370359 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-87930bb1-2851-4aa0-b1f6-b9f732fde3e3 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:33.370788 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-87930bb1-2851-4aa0-b1f6-b9f732fde3e3 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:33.371474 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-87930bb1-2851-4aa0-b1f6-b9f732fde3e3 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:33.371921 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-87930bb1-2851-4aa0-b1f6-b9f732fde3e3 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:33.372346 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-87930bb1-2851-4aa0-b1f6-b9f732fde3e3 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:33.402918 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-87930bb1-2851-4aa0-b1f6-b9f732fde3e3 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d/os-volume_attachments/65f14f66-ffbe-45d6-a29c-35bfc9a8b155" status: 200 len: 194 microversion: 2.1 time: 0.044954 Aug 24 03:35:33.404100 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 310/609] 10.222.0.81 () {58 vars in 1413 bytes} [Wed Aug 24 03:35:33 2022] GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d/os-volume_attachments/65f14f66-ffbe-45d6-a29c-35bfc9a8b155 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:34.810973 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-95497456-92a1-404f-8638-e9d00089b836 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2acbde49-02b5-4fd5-a2a7-3265ff1b3213"}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:34.813593 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-95497456-92a1-404f-8638-e9d00089b836 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: add1236d-0d50-4a63-8e61-9046f9d8b42d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:34.824975 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-95497456-92a1-404f-8638-e9d00089b836 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:34.829276 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-95497456-92a1-404f-8638-e9d00089b836 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:34.829784 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-95497456-92a1-404f-8638-e9d00089b836 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:34.830533 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-95497456-92a1-404f-8638-e9d00089b836 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:34.831005 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-95497456-92a1-404f-8638-e9d00089b836 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:34.831437 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-95497456-92a1-404f-8638-e9d00089b836 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:35.193703 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-95497456-92a1-404f-8638-e9d00089b836 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "POST /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.387040 Aug 24 03:35:35.195437 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 300/610] 10.222.0.81 () {60 vars in 1323 bytes} [Wed Aug 24 03:35:34 2022] POST /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d/os-volume_attachments => generated 194 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:38.406701 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-5b0f4d4e-8d6f-4508-80ec-0726d4d36977 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Action: 'create', calling method: .version_select at 0x7f942f30a160>, body: {"keypair": {"name": "tempest-TestShelveInstance-1590201589", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMoRsbNHHoxZN8H4kL8jFg26iv4q35jMT8qh3EL8ZZrO2CBplqOgvOQdXiFIiDKDLxvJAoANPJfaBTg0jyRBAmQ2DenQXpR6if90r70XZb7cE6Zwar5eKCbZobxXprJLw=="}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:38.425136 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.quota [None req-5b0f4d4e-8d6f-4508-80ec-0726d4d36977 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Getting quotas for project 5dea7fb32dea4f75917d82973bf7e7e6. Resources: {'key_pairs'} {{(pid=120709) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:35:38.431655 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.quota [None req-5b0f4d4e-8d6f-4508-80ec-0726d4d36977 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Getting quotas for user e5588121cc364d30a8f01d17c4cfc6df and project 5dea7fb32dea4f75917d82973bf7e7e6. Resources: {'key_pairs'} {{(pid=120709) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:35:38.462151 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-5b0f4d4e-8d6f-4508-80ec-0726d4d36977 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.283002 Aug 24 03:35:38.462743 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 311/611] 10.222.0.81 () {60 vars in 1159 bytes} [Wed Aug 24 03:35:38 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:42.903256 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-11cc0713-3671-4ce5-9112-be8a7ec3300f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:42.905537 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-11cc0713-3671-4ce5-9112-be8a7ec3300f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: add1236d-0d50-4a63-8e61-9046f9d8b42d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:42.912155 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-11cc0713-3671-4ce5-9112-be8a7ec3300f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:42.912422 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-11cc0713-3671-4ce5-9112-be8a7ec3300f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:42.912910 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-11cc0713-3671-4ce5-9112-be8a7ec3300f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:42.913613 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-11cc0713-3671-4ce5-9112-be8a7ec3300f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:42.914068 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-11cc0713-3671-4ce5-9112-be8a7ec3300f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:42.914492 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-11cc0713-3671-4ce5-9112-be8a7ec3300f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:42.944698 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-11cc0713-3671-4ce5-9112-be8a7ec3300f tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046317 Aug 24 03:35:42.945387 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 301/612] 10.222.0.81 () {58 vars in 1302 bytes} [Wed Aug 24 03:35:42 2022] GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:43.093420 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-e268a84a-860d-41c3-8fbc-90e2b2fe65cf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:43.094092 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-e268a84a-860d-41c3-8fbc-90e2b2fe65cf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: add1236d-0d50-4a63-8e61-9046f9d8b42d] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:43.097160 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:43.103604 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e268a84a-860d-41c3-8fbc-90e2b2fe65cf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:43.104798 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e268a84a-860d-41c3-8fbc-90e2b2fe65cf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:43.105386 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e268a84a-860d-41c3-8fbc-90e2b2fe65cf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:43.106358 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e268a84a-860d-41c3-8fbc-90e2b2fe65cf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:43.107018 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e268a84a-860d-41c3-8fbc-90e2b2fe65cf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:43.107627 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e268a84a-860d-41c3-8fbc-90e2b2fe65cf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:43.112846 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell1:SELECT=73 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:43.141572 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-e268a84a-860d-41c3-8fbc-90e2b2fe65cf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d/os-volume_attachments/65f14f66-ffbe-45d6-a29c-35bfc9a8b155" status: 200 len: 194 microversion: 2.1 time: 0.054054 Aug 24 03:35:43.142364 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 312/613] 10.222.0.81 () {58 vars in 1413 bytes} [Wed Aug 24 03:35:43 2022] GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d/os-volume_attachments/65f14f66-ffbe-45d6-a29c-35bfc9a8b155 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:43.152563 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f2bec0e5-5edd-4465-b124-d6832bb80f5b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:43.153091 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f2bec0e5-5edd-4465-b124-d6832bb80f5b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: add1236d-0d50-4a63-8e61-9046f9d8b42d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:43.159314 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f2bec0e5-5edd-4465-b124-d6832bb80f5b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:43.159792 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f2bec0e5-5edd-4465-b124-d6832bb80f5b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:43.160227 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f2bec0e5-5edd-4465-b124-d6832bb80f5b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:43.160959 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f2bec0e5-5edd-4465-b124-d6832bb80f5b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:43.161414 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f2bec0e5-5edd-4465-b124-d6832bb80f5b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:43.161836 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f2bec0e5-5edd-4465-b124-d6832bb80f5b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:43.246671 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.objects.instance [None req-f2bec0e5-5edd-4465-b124-d6832bb80f5b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lazy-loading 'services' on Instance uuid add1236d-0d50-4a63-8e61-9046f9d8b42d {{(pid=120708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:35:43.320188 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f2bec0e5-5edd-4465-b124-d6832bb80f5b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "DELETE /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d/os-volume_attachments/65f14f66-ffbe-45d6-a29c-35bfc9a8b155" status: 202 len: 0 microversion: 2.1 time: 0.171441 Aug 24 03:35:43.324022 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 302/614] 10.222.0.81 () {58 vars in 1416 bytes} [Wed Aug 24 03:35:43 2022] DELETE /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d/os-volume_attachments/65f14f66-ffbe-45d6-a29c-35bfc9a8b155 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:35:45.518406 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-79d210a0-c262-4e95-adb1-8414c4226669 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:45.519007 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-79d210a0-c262-4e95-adb1-8414c4226669 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: add1236d-0d50-4a63-8e61-9046f9d8b42d] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:45.525649 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-79d210a0-c262-4e95-adb1-8414c4226669 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:45.526168 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-79d210a0-c262-4e95-adb1-8414c4226669 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:45.527274 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-79d210a0-c262-4e95-adb1-8414c4226669 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:45.527993 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-79d210a0-c262-4e95-adb1-8414c4226669 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:45.528453 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-79d210a0-c262-4e95-adb1-8414c4226669 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:45.528938 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-79d210a0-c262-4e95-adb1-8414c4226669 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:45.560409 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-79d210a0-c262-4e95-adb1-8414c4226669 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d/os-volume_attachments/2acbde49-02b5-4fd5-a2a7-3265ff1b3213" status: 200 len: 194 microversion: 2.1 time: 0.046079 Aug 24 03:35:45.561023 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 313/615] 10.222.0.81 () {58 vars in 1413 bytes} [Wed Aug 24 03:35:45 2022] GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d/os-volume_attachments/2acbde49-02b5-4fd5-a2a7-3265ff1b3213 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:45.572416 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-df345df5-faf0-4081-8571-985d7454e301 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:45.573101 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-df345df5-faf0-4081-8571-985d7454e301 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: add1236d-0d50-4a63-8e61-9046f9d8b42d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:45.580291 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-df345df5-faf0-4081-8571-985d7454e301 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:45.580818 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-df345df5-faf0-4081-8571-985d7454e301 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:45.581261 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-df345df5-faf0-4081-8571-985d7454e301 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:45.581951 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-df345df5-faf0-4081-8571-985d7454e301 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:45.582402 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-df345df5-faf0-4081-8571-985d7454e301 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:45.582825 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-df345df5-faf0-4081-8571-985d7454e301 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:45.666144 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.objects.instance [None req-df345df5-faf0-4081-8571-985d7454e301 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lazy-loading 'services' on Instance uuid add1236d-0d50-4a63-8e61-9046f9d8b42d {{(pid=120708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:35:45.740165 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-df345df5-faf0-4081-8571-985d7454e301 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "DELETE /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d/os-volume_attachments/2acbde49-02b5-4fd5-a2a7-3265ff1b3213" status: 202 len: 0 microversion: 2.1 time: 0.172371 Aug 24 03:35:45.740977 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 303/616] 10.222.0.81 () {58 vars in 1416 bytes} [Wed Aug 24 03:35:45 2022] DELETE /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d/os-volume_attachments/2acbde49-02b5-4fd5-a2a7-3265ff1b3213 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:35:46.913306 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-2b2bb76c-8f91-4761-b502-14b02fc5b928 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:46.915436 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-2b2bb76c-8f91-4761-b502-14b02fc5b928 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: add1236d-0d50-4a63-8e61-9046f9d8b42d] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:46.921923 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2b2bb76c-8f91-4761-b502-14b02fc5b928 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:46.922411 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2b2bb76c-8f91-4761-b502-14b02fc5b928 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:46.922852 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2b2bb76c-8f91-4761-b502-14b02fc5b928 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:46.923538 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2b2bb76c-8f91-4761-b502-14b02fc5b928 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:46.923992 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2b2bb76c-8f91-4761-b502-14b02fc5b928 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:46.924416 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2b2bb76c-8f91-4761-b502-14b02fc5b928 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:46.954545 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-2b2bb76c-8f91-4761-b502-14b02fc5b928 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045157 Aug 24 03:35:46.955090 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 314/617] 10.222.0.81 () {58 vars in 1302 bytes} [Wed Aug 24 03:35:46 2022] GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:35:47.072873 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b10b072c-9e9e-4885-b152-a100aa41ea62 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:47.075889 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-b10b072c-9e9e-4885-b152-a100aa41ea62 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: add1236d-0d50-4a63-8e61-9046f9d8b42d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:47.082716 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b10b072c-9e9e-4885-b152-a100aa41ea62 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:47.083210 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b10b072c-9e9e-4885-b152-a100aa41ea62 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:47.083643 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b10b072c-9e9e-4885-b152-a100aa41ea62 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:47.084348 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b10b072c-9e9e-4885-b152-a100aa41ea62 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:47.084841 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b10b072c-9e9e-4885-b152-a100aa41ea62 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:47.085275 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b10b072c-9e9e-4885-b152-a100aa41ea62 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:47.115550 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-b10b072c-9e9e-4885-b152-a100aa41ea62 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046870 Aug 24 03:35:47.116097 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 304/618] 10.222.0.81 () {58 vars in 1302 bytes} [Wed Aug 24 03:35:47 2022] GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:35:47.185193 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-5771fffd-8553-442e-afd0-d7267a2b4952 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:47.185694 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-5771fffd-8553-442e-afd0-d7267a2b4952 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: add1236d-0d50-4a63-8e61-9046f9d8b42d] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:47.191658 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5771fffd-8553-442e-afd0-d7267a2b4952 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:47.192146 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5771fffd-8553-442e-afd0-d7267a2b4952 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:47.192580 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5771fffd-8553-442e-afd0-d7267a2b4952 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:47.193300 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5771fffd-8553-442e-afd0-d7267a2b4952 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:47.193753 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5771fffd-8553-442e-afd0-d7267a2b4952 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:47.194176 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5771fffd-8553-442e-afd0-d7267a2b4952 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:47.221486 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-5771fffd-8553-442e-afd0-d7267a2b4952 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: add1236d-0d50-4a63-8e61-9046f9d8b42d] Going to try to terminate instance {{(pid=120709) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:35:47.304715 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-5771fffd-8553-442e-afd0-d7267a2b4952 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "DELETE /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d" status: 204 len: 0 microversion: 2.1 time: 0.122669 Aug 24 03:35:47.305958 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 315/619] 10.222.0.81 () {58 vars in 1239 bytes} [Wed Aug 24 03:35:47 2022] DELETE /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:35:47.315653 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ab91a73a-f35f-4b11-93ee-2a949b8fc615 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:47.316259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ab91a73a-f35f-4b11-93ee-2a949b8fc615 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: add1236d-0d50-4a63-8e61-9046f9d8b42d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:47.322528 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ab91a73a-f35f-4b11-93ee-2a949b8fc615 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:47.324266 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ab91a73a-f35f-4b11-93ee-2a949b8fc615 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:47.325192 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ab91a73a-f35f-4b11-93ee-2a949b8fc615 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:47.325626 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ab91a73a-f35f-4b11-93ee-2a949b8fc615 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:47.326087 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ab91a73a-f35f-4b11-93ee-2a949b8fc615 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:47.326508 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ab91a73a-f35f-4b11-93ee-2a949b8fc615 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:47.476262 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ab91a73a-f35f-4b11-93ee-2a949b8fc615 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:47.479868 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:47.485194 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ab91a73a-f35f-4b11-93ee-2a949b8fc615 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d" status: 200 len: 1671 microversion: 2.1 time: 0.173595 Aug 24 03:35:47.485930 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 305/620] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:47 2022] GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d => generated 1671 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:48.508210 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-847281a0-6a23-4055-99d4-0f403adfb4ca tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:48.508866 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-847281a0-6a23-4055-99d4-0f403adfb4ca tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: add1236d-0d50-4a63-8e61-9046f9d8b42d] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:48.512040 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell0:SELECT=4 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:48.517777 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-847281a0-6a23-4055-99d4-0f403adfb4ca tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:48.518300 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-847281a0-6a23-4055-99d4-0f403adfb4ca tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:48.518754 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-847281a0-6a23-4055-99d4-0f403adfb4ca tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:48.519458 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-847281a0-6a23-4055-99d4-0f403adfb4ca tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:48.519918 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-847281a0-6a23-4055-99d4-0f403adfb4ca tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:48.520346 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-847281a0-6a23-4055-99d4-0f403adfb4ca tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:48.656654 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-847281a0-6a23-4055-99d4-0f403adfb4ca tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:48.664413 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-847281a0-6a23-4055-99d4-0f403adfb4ca tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d" status: 200 len: 1671 microversion: 2.1 time: 0.160512 Aug 24 03:35:48.664991 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 316/621] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:48 2022] GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:49.686368 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c6c5c784-de41-4ec9-9abd-0cb8e56e1a0a tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:49.687005 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c6c5c784-de41-4ec9-9abd-0cb8e56e1a0a tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: add1236d-0d50-4a63-8e61-9046f9d8b42d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:49.689270 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=23 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:49.695205 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c6c5c784-de41-4ec9-9abd-0cb8e56e1a0a tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:49.695689 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c6c5c784-de41-4ec9-9abd-0cb8e56e1a0a tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:49.696121 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c6c5c784-de41-4ec9-9abd-0cb8e56e1a0a tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:49.696845 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c6c5c784-de41-4ec9-9abd-0cb8e56e1a0a tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:49.697300 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c6c5c784-de41-4ec9-9abd-0cb8e56e1a0a tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:49.697724 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c6c5c784-de41-4ec9-9abd-0cb8e56e1a0a tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:50.087153 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c6c5c784-de41-4ec9-9abd-0cb8e56e1a0a tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:50.095837 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c6c5c784-de41-4ec9-9abd-0cb8e56e1a0a tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d" status: 200 len: 1671 microversion: 2.1 time: 0.414467 Aug 24 03:35:50.096391 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 306/622] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:49 2022] GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d => generated 1671 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:51.116403 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-ea7d760d-f71e-4ab4-88ce-946bb9e7df65 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:51.117098 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-ea7d760d-f71e-4ab4-88ce-946bb9e7df65 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: add1236d-0d50-4a63-8e61-9046f9d8b42d] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:51.124378 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ea7d760d-f71e-4ab4-88ce-946bb9e7df65 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:51.124906 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ea7d760d-f71e-4ab4-88ce-946bb9e7df65 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:51.125350 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ea7d760d-f71e-4ab4-88ce-946bb9e7df65 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:51.126082 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ea7d760d-f71e-4ab4-88ce-946bb9e7df65 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:51.126540 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ea7d760d-f71e-4ab4-88ce-946bb9e7df65 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:51.126970 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ea7d760d-f71e-4ab4-88ce-946bb9e7df65 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:51.252235 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-ea7d760d-f71e-4ab4-88ce-946bb9e7df65 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:51.259890 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-ea7d760d-f71e-4ab4-88ce-946bb9e7df65 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d" status: 200 len: 1671 microversion: 2.1 time: 0.147341 Aug 24 03:35:51.260461 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 317/623] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:51 2022] GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d => generated 1671 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:52.282938 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c9f6e6ef-c369-4e02-94c5-c8f1b03b4adf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:52.283448 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c9f6e6ef-c369-4e02-94c5-c8f1b03b4adf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: add1236d-0d50-4a63-8e61-9046f9d8b42d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:52.289792 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c9f6e6ef-c369-4e02-94c5-c8f1b03b4adf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:52.290276 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c9f6e6ef-c369-4e02-94c5-c8f1b03b4adf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:52.290705 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c9f6e6ef-c369-4e02-94c5-c8f1b03b4adf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:52.291385 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c9f6e6ef-c369-4e02-94c5-c8f1b03b4adf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:52.291916 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c9f6e6ef-c369-4e02-94c5-c8f1b03b4adf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:52.292337 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c9f6e6ef-c369-4e02-94c5-c8f1b03b4adf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:52.423555 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c9f6e6ef-c369-4e02-94c5-c8f1b03b4adf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:52.431733 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c9f6e6ef-c369-4e02-94c5-c8f1b03b4adf tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d" status: 200 len: 1671 microversion: 2.1 time: 0.152639 Aug 24 03:35:52.432311 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 307/624] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:52 2022] GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:53.453672 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-d282723d-a83d-451d-929f-87b9217c44bc tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:53.454278 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-d282723d-a83d-451d-929f-87b9217c44bc tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: add1236d-0d50-4a63-8e61-9046f9d8b42d] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:53.460599 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d282723d-a83d-451d-929f-87b9217c44bc tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:53.461108 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d282723d-a83d-451d-929f-87b9217c44bc tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:53.461540 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d282723d-a83d-451d-929f-87b9217c44bc tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:53.462219 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d282723d-a83d-451d-929f-87b9217c44bc tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:53.462665 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d282723d-a83d-451d-929f-87b9217c44bc tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:53.463080 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d282723d-a83d-451d-929f-87b9217c44bc tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:53.602685 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-d282723d-a83d-451d-929f-87b9217c44bc tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:53.610634 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-d282723d-a83d-451d-929f-87b9217c44bc tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d" status: 200 len: 1671 microversion: 2.1 time: 0.160838 Aug 24 03:35:53.611203 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 318/625] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:53 2022] GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:54.631691 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b56571df-8226-497e-8b0e-477ef1154ad5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:54.632305 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-b56571df-8226-497e-8b0e-477ef1154ad5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: add1236d-0d50-4a63-8e61-9046f9d8b42d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:54.639470 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b56571df-8226-497e-8b0e-477ef1154ad5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:54.639957 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b56571df-8226-497e-8b0e-477ef1154ad5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:54.640387 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b56571df-8226-497e-8b0e-477ef1154ad5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:54.641107 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b56571df-8226-497e-8b0e-477ef1154ad5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:54.641563 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b56571df-8226-497e-8b0e-477ef1154ad5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:54.641989 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b56571df-8226-497e-8b0e-477ef1154ad5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:54.712306 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-b56571df-8226-497e-8b0e-477ef1154ad5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66900b813b934514a7920ba975a05ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1e9994c1c045c892059d5b80578ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:54.721608 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-b56571df-8226-497e-8b0e-477ef1154ad5 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d" status: 200 len: 1604 microversion: 2.1 time: 0.093721 Aug 24 03:35:54.735761 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 308/626] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:54 2022] GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d => generated 1604 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:35:55.063363 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-5187f59c-8df1-441f-b174-99a9daf10e4b req-1c00def9-b55b-43ad-8e93-c94b47ff780c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "add1236d-0d50-4a63-8e61-9046f9d8b42d", "name": "network-vif-deleted", "tag": "5619faf8-463d-4ee6-862c-26779d2f1963"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:55.076580 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-5187f59c-8df1-441f-b174-99a9daf10e4b req-1c00def9-b55b-43ad-8e93-c94b47ff780c service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:55.077099 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-5187f59c-8df1-441f-b174-99a9daf10e4b req-1c00def9-b55b-43ad-8e93-c94b47ff780c service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:55.077529 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-5187f59c-8df1-441f-b174-99a9daf10e4b req-1c00def9-b55b-43ad-8e93-c94b47ff780c service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:55.103053 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-5187f59c-8df1-441f-b174-99a9daf10e4b req-1c00def9-b55b-43ad-8e93-c94b47ff780c service nova] Creating event network-vif-deleted:5619faf8-463d-4ee6-862c-26779d2f1963 for instance add1236d-0d50-4a63-8e61-9046f9d8b42d on hv-cinder-85426 Aug 24 03:35:55.116147 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-5187f59c-8df1-441f-b174-99a9daf10e4b req-1c00def9-b55b-43ad-8e93-c94b47ff780c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163040 Aug 24 03:35:55.122001 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 319/627] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:35:55.743507 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-e728d551-e6d9-4813-9efa-64cb52f39a31 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:55.744125 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-e728d551-e6d9-4813-9efa-64cb52f39a31 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: add1236d-0d50-4a63-8e61-9046f9d8b42d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:55.751143 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e728d551-e6d9-4813-9efa-64cb52f39a31 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:55.751661 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e728d551-e6d9-4813-9efa-64cb52f39a31 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:55.752095 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e728d551-e6d9-4813-9efa-64cb52f39a31 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:55.752817 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e728d551-e6d9-4813-9efa-64cb52f39a31 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:55.753275 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e728d551-e6d9-4813-9efa-64cb52f39a31 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:55.753704 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e728d551-e6d9-4813-9efa-64cb52f39a31 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:55.767354 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-e728d551-e6d9-4813-9efa-64cb52f39a31 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] HTTP exception thrown: Instance add1236d-0d50-4a63-8e61-9046f9d8b42d could not be found. Aug 24 03:35:55.769044 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-e728d551-e6d9-4813-9efa-64cb52f39a31 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Request method failure captured: Aug 24 03:35:55.769044 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d HTTP/1.1 Aug 24 03:35:55.769044 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 24 03:35:55.769044 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 24 03:35:55.769044 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Connection: close Aug 24 03:35:55.769044 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 24 03:35:55.769044 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 24 03:35:55.769044 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Host: 10.222.0.81 Aug 24 03:35:55.769044 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 24 03:35:55.769044 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.11 Aug 24 03:35:55.769044 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjBZtP_wpwR9Y3bAcDYGBOT0mwVsByRvMetP-LFXmeiOuOHDaCm33H67I99DE_xaqBHlQVAXqo42-hQvceoTyzqUaUrREzwFCjB5uheciPzS-0oo6Dt1FFFg2gNgREWRC2xcQUJRjSVnFD9346HbvgMLQDPZu_rRgzBO_s4TcXYCjCPTI Aug 24 03:35:55.769044 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 24 03:35:55.769044 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 24 03:35:55.769044 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 24 03:35:55.769044 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 24 03:35:55.769044 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 24 03:35:55.769044 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 24 03:35:55.769044 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Id: 6a1e9994c1c045c892059d5b80578ba7 Aug 24 03:35:55.769044 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-AttachVolumeTestJSON-1807952205 Aug 24 03:35:55.769044 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 24 03:35:55.769044 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 24 03:35:55.770609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6a1e9994c1c045c892059d5b80578ba7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6a1e9994c1c045c892059d5b80578ba7", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6a1e9994c1c045c892059d5b80578ba7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6a1e9994c1c045c892059d5b80578ba7"}]}] Aug 24 03:35:55.770609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-AttachVolumeTestJSON-1807952205 Aug 24 03:35:55.770609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 6a1e9994c1c045c892059d5b80578ba7 Aug 24 03:35:55.770609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1807952205 Aug 24 03:35:55.770609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User: tempest-AttachVolumeTestJSON-1807952205-project Aug 24 03:35:55.770609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 24 03:35:55.770609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 24 03:35:55.770609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Id: 66900b813b934514a7920ba975a05ec5 Aug 24 03:35:55.770609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-AttachVolumeTestJSON-1807952205-project Aug 24 03:35:55.770609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: method: > Aug 24 03:35:55.770609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: exception: Instance add1236d-0d50-4a63-8e61-9046f9d8b42d could not be found. Aug 24 03:35:55.770609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: action_args: {'id': 'add1236d-0d50-4a63-8e61-9046f9d8b42d'} Aug 24 03:35:55.771441 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:35:55.771441 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:55.771441 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:35:55.771441 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:35:55.771441 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:35:55.771441 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:35:55.771441 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:35:55.771441 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:35:55.771441 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:35:55.771441 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:35:55.771441 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance add1236d-0d50-4a63-8e61-9046f9d8b42d could not be found. Aug 24 03:35:55.771441 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:35:55.771441 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:55.771441 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:35:55.771441 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:55.771441 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:55.771441 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:55.771441 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:35:55.771441 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:35:55.771441 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:35:55.773016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:35:55.773016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:35:55.773016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:35:55.773016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:35:55.773016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:35:55.773016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:35:55.773016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:35:55.773016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance add1236d-0d50-4a63-8e61-9046f9d8b42d could not be found. Aug 24 03:35:55.773016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:35:55.773016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:55.773016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:35:55.773016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:55.773016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:55.773016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:55.773016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:35:55.773016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:35:55.773016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance add1236d-0d50-4a63-8e61-9046f9d8b42d could not be found. Aug 24 03:35:55.773016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:35:55.774132 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-e728d551-e6d9-4813-9efa-64cb52f39a31 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Returning 404 to user: Instance add1236d-0d50-4a63-8e61-9046f9d8b42d could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:35:55.774132 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-e728d551-e6d9-4813-9efa-64cb52f39a31 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d" status: 404 len: 111 microversion: 2.1 time: 0.030904 Aug 24 03:35:55.774132 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 309/628] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:55 2022] GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:35:55.781331 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-785ca84c-cc0d-4604-a4fa-dfd1ebb6a7e9 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '.version_select at 0x7f942f30a3a0>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:55.802138 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-785ca84c-cc0d-4604-a4fa-dfd1ebb6a7e9 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-982709269" status: 202 len: 0 microversion: 2.1 time: 0.025786 Aug 24 03:35:55.803302 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 320/629] 10.222.0.81 () {58 vars in 1218 bytes} [Wed Aug 24 03:35:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-982709269 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:35:58.724976 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-913c0290-3cb9-4a3c-ae0b-64bb4cde8c43 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:58.725545 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-913c0290-3cb9-4a3c-ae0b-64bb4cde8c43 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: add1236d-0d50-4a63-8e61-9046f9d8b42d] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:58.732519 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-913c0290-3cb9-4a3c-ae0b-64bb4cde8c43 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:58.733026 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-913c0290-3cb9-4a3c-ae0b-64bb4cde8c43 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:58.733467 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-913c0290-3cb9-4a3c-ae0b-64bb4cde8c43 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:58.734152 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-913c0290-3cb9-4a3c-ae0b-64bb4cde8c43 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:58.734605 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-913c0290-3cb9-4a3c-ae0b-64bb4cde8c43 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:58.735028 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-913c0290-3cb9-4a3c-ae0b-64bb4cde8c43 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:58.748148 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-913c0290-3cb9-4a3c-ae0b-64bb4cde8c43 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] HTTP exception thrown: Instance add1236d-0d50-4a63-8e61-9046f9d8b42d could not be found. Aug 24 03:35:58.749689 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-913c0290-3cb9-4a3c-ae0b-64bb4cde8c43 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Request method failure captured: Aug 24 03:35:58.749689 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: request: DELETE /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d HTTP/1.1 Aug 24 03:35:58.749689 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 24 03:35:58.749689 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 24 03:35:58.749689 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Connection: close Aug 24 03:35:58.749689 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 24 03:35:58.749689 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 24 03:35:58.749689 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Host: 10.222.0.81 Aug 24 03:35:58.749689 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 24 03:35:58.749689 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.11 Aug 24 03:35:58.749689 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjBZtP_wpwR9Y3bAcDYGBOT0mwVsByRvMetP-LFXmeiOuOHDaCm33H67I99DE_xaqBHlQVAXqo42-hQvceoTyzqUaUrREzwFCjB5uheciPzS-0oo6Dt1FFFg2gNgREWRC2xcQUJRjSVnFD9346HbvgMLQDPZu_rRgzBO_s4TcXYCjCPTI Aug 24 03:35:58.749689 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 24 03:35:58.749689 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 24 03:35:58.749689 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 24 03:35:58.749689 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 24 03:35:58.749689 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 24 03:35:58.749689 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 24 03:35:58.749689 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Id: 6a1e9994c1c045c892059d5b80578ba7 Aug 24 03:35:58.749689 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-AttachVolumeTestJSON-1807952205 Aug 24 03:35:58.749689 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 24 03:35:58.749689 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 24 03:35:58.751259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6a1e9994c1c045c892059d5b80578ba7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6a1e9994c1c045c892059d5b80578ba7", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6a1e9994c1c045c892059d5b80578ba7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6a1e9994c1c045c892059d5b80578ba7"}]}] Aug 24 03:35:58.751259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-AttachVolumeTestJSON-1807952205 Aug 24 03:35:58.751259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 6a1e9994c1c045c892059d5b80578ba7 Aug 24 03:35:58.751259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1807952205 Aug 24 03:35:58.751259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User: tempest-AttachVolumeTestJSON-1807952205-project Aug 24 03:35:58.751259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 24 03:35:58.751259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 24 03:35:58.751259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Id: 66900b813b934514a7920ba975a05ec5 Aug 24 03:35:58.751259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-AttachVolumeTestJSON-1807952205-project Aug 24 03:35:58.751259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: method: > Aug 24 03:35:58.751259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: exception: Instance add1236d-0d50-4a63-8e61-9046f9d8b42d could not be found. Aug 24 03:35:58.751259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: action_args: {'id': 'add1236d-0d50-4a63-8e61-9046f9d8b42d'} Aug 24 03:35:58.752176 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:35:58.752176 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:58.752176 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:35:58.752176 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:35:58.752176 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:35:58.752176 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:35:58.752176 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:35:58.752176 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:35:58.752176 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:35:58.752176 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:35:58.752176 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance add1236d-0d50-4a63-8e61-9046f9d8b42d could not be found. Aug 24 03:35:58.752176 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:35:58.752176 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:58.752176 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:35:58.752176 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:58.752176 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:58.752176 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:58.752176 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:35:58.752176 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:35:58.752176 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:35:58.753656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:35:58.753656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:35:58.753656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:35:58.753656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:35:58.753656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:35:58.753656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:35:58.753656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:35:58.753656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:35:58.753656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:35:58.753656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance add1236d-0d50-4a63-8e61-9046f9d8b42d could not be found. Aug 24 03:35:58.753656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:35:58.753656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:58.753656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:35:58.753656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:58.753656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:58.753656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:58.753656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:35:58.753656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:35:58.753656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance add1236d-0d50-4a63-8e61-9046f9d8b42d could not be found. Aug 24 03:35:58.753656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:35:58.755108 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-913c0290-3cb9-4a3c-ae0b-64bb4cde8c43 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Returning 404 to user: Instance add1236d-0d50-4a63-8e61-9046f9d8b42d could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:35:58.755108 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-913c0290-3cb9-4a3c-ae0b-64bb4cde8c43 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "DELETE /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d" status: 404 len: 111 microversion: 2.1 time: 0.029945 Aug 24 03:35:58.755108 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 310/630] 10.222.0.81 () {58 vars in 1239 bytes} [Wed Aug 24 03:35:58 2022] DELETE /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:35:58.760378 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-766bd487-3cb0-4bc9-b3f5-07170d8f24d1 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:58.761672 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-766bd487-3cb0-4bc9-b3f5-07170d8f24d1 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: add1236d-0d50-4a63-8e61-9046f9d8b42d] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:58.768048 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-766bd487-3cb0-4bc9-b3f5-07170d8f24d1 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:58.768560 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-766bd487-3cb0-4bc9-b3f5-07170d8f24d1 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:58.769050 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-766bd487-3cb0-4bc9-b3f5-07170d8f24d1 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:58.769823 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-766bd487-3cb0-4bc9-b3f5-07170d8f24d1 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:58.770300 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-766bd487-3cb0-4bc9-b3f5-07170d8f24d1 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:58.770796 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-766bd487-3cb0-4bc9-b3f5-07170d8f24d1 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:58.786047 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.wsgi [None req-766bd487-3cb0-4bc9-b3f5-07170d8f24d1 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] HTTP exception thrown: Instance add1236d-0d50-4a63-8e61-9046f9d8b42d could not be found. Aug 24 03:35:58.787893 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-766bd487-3cb0-4bc9-b3f5-07170d8f24d1 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Request method failure captured: Aug 24 03:35:58.787893 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: request: GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d HTTP/1.1 Aug 24 03:35:58.787893 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept: application/json Aug 24 03:35:58.787893 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept-Encoding: identity Aug 24 03:35:58.787893 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Connection: close Aug 24 03:35:58.787893 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Length: 0 Aug 24 03:35:58.787893 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Type: application/json Aug 24 03:35:58.787893 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Host: 10.222.0.81 Aug 24 03:35:58.787893 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Openstack-System-Scope: None Aug 24 03:35:58.787893 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: User-Agent: python-urllib3/1.26.11 Aug 24 03:35:58.787893 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Auth-Token: gAAAAABjBZtP_wpwR9Y3bAcDYGBOT0mwVsByRvMetP-LFXmeiOuOHDaCm33H67I99DE_xaqBHlQVAXqo42-hQvceoTyzqUaUrREzwFCjB5uheciPzS-0oo6Dt1FFFg2gNgREWRC2xcQUJRjSVnFD9346HbvgMLQDPZu_rRgzBO_s4TcXYCjCPTI Aug 24 03:35:58.787893 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Id: None Aug 24 03:35:58.787893 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Name: None Aug 24 03:35:58.787893 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Identity-Status: Confirmed Aug 24 03:35:58.787893 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Is-Admin-Project: True Aug 24 03:35:58.787893 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Id: default Aug 24 03:35:58.787893 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Name: Default Aug 24 03:35:58.787893 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Id: 6a1e9994c1c045c892059d5b80578ba7 Aug 24 03:35:58.787893 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Name: tempest-AttachVolumeTestJSON-1807952205 Aug 24 03:35:58.787893 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Role: reader,member Aug 24 03:35:58.787893 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Roles: reader,member Aug 24 03:35:58.789419 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6a1e9994c1c045c892059d5b80578ba7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6a1e9994c1c045c892059d5b80578ba7", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6a1e9994c1c045c892059d5b80578ba7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6a1e9994c1c045c892059d5b80578ba7"}]}] Aug 24 03:35:58.789419 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant: tempest-AttachVolumeTestJSON-1807952205 Aug 24 03:35:58.789419 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Id: 6a1e9994c1c045c892059d5b80578ba7 Aug 24 03:35:58.789419 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1807952205 Aug 24 03:35:58.789419 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User: tempest-AttachVolumeTestJSON-1807952205-project Aug 24 03:35:58.789419 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Id: default Aug 24 03:35:58.789419 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Name: Default Aug 24 03:35:58.789419 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Id: 66900b813b934514a7920ba975a05ec5 Aug 24 03:35:58.789419 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Name: tempest-AttachVolumeTestJSON-1807952205-project Aug 24 03:35:58.789419 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: method: > Aug 24 03:35:58.789419 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: exception: Instance add1236d-0d50-4a63-8e61-9046f9d8b42d could not be found. Aug 24 03:35:58.789419 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: action_args: {'id': 'add1236d-0d50-4a63-8e61-9046f9d8b42d'} Aug 24 03:35:58.790287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:35:58.790287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:58.790287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:35:58.790287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:35:58.790287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:35:58.790287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:35:58.790287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:35:58.790287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:35:58.790287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:35:58.790287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:35:58.790287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance add1236d-0d50-4a63-8e61-9046f9d8b42d could not be found. Aug 24 03:35:58.790287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:35:58.790287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:58.790287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:35:58.790287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:58.790287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:58.790287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:58.790287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:35:58.790287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:35:58.790287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:35:58.791678 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:35:58.791678 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:35:58.791678 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:35:58.791678 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:35:58.791678 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:35:58.791678 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:35:58.791678 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:35:58.791678 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance add1236d-0d50-4a63-8e61-9046f9d8b42d could not be found. Aug 24 03:35:58.791678 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:35:58.791678 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:58.791678 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:35:58.791678 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:58.791678 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:58.791678 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:58.791678 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:35:58.791678 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:35:58.791678 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance add1236d-0d50-4a63-8e61-9046f9d8b42d could not be found. Aug 24 03:35:58.791678 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:35:58.794289 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-766bd487-3cb0-4bc9-b3f5-07170d8f24d1 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Returning 404 to user: Instance add1236d-0d50-4a63-8e61-9046f9d8b42d could not be found. {{(pid=120709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:35:58.794289 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-766bd487-3cb0-4bc9-b3f5-07170d8f24d1 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d" status: 404 len: 111 microversion: 2.1 time: 0.033950 Aug 24 03:35:58.794289 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 321/631] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:58 2022] GET /compute/v2.1/servers/add1236d-0d50-4a63-8e61-9046f9d8b42d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:35:59.387618 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0a43f972-044e-48e2-a667-98e3f6d3a906 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-791279839", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1590201589", "security_groups": [{"name": "tempest-secgroup-smoke-756402751"}], "networks": [{"uuid": "1be8ff91-ce37-47a5-8ee2-27d898bd3b76"}], "block_device_mapping_v2": [{"uuid": "baf9899d-5bdb-4835-ba62-880e9a3943a5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:59.500359 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.network.neutron [None req-0a43f972-044e-48e2-a667-98e3f6d3a906 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] validate_networks() for [('1be8ff91-ce37-47a5-8ee2-27d898bd3b76', None, None, None, None, None)] {{(pid=120708) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:35:59.937565 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-e50779f5-ca4b-4e65-8798-f7cc1a748a86 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:59.938077 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-e50779f5-ca4b-4e65-8798-f7cc1a748a86 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:59.944454 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e50779f5-ca4b-4e65-8798-f7cc1a748a86 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:59.944975 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e50779f5-ca4b-4e65-8798-f7cc1a748a86 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:59.945419 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e50779f5-ca4b-4e65-8798-f7cc1a748a86 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:59.946257 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e50779f5-ca4b-4e65-8798-f7cc1a748a86 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:59.946754 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e50779f5-ca4b-4e65-8798-f7cc1a748a86 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:59.947189 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e50779f5-ca4b-4e65-8798-f7cc1a748a86 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:59.960908 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.wsgi [None req-e50779f5-ca4b-4e65-8798-f7cc1a748a86 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] HTTP exception thrown: Instance 9b97b3d6-5022-46c8-a189-fed177d028c8 could not be found. Aug 24 03:35:59.962461 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-e50779f5-ca4b-4e65-8798-f7cc1a748a86 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Request method failure captured: Aug 24 03:35:59.962461 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: request: DELETE /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 HTTP/1.1 Aug 24 03:35:59.962461 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept: application/json Aug 24 03:35:59.962461 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept-Encoding: identity Aug 24 03:35:59.962461 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Connection: close Aug 24 03:35:59.962461 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Length: 0 Aug 24 03:35:59.962461 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Type: application/json Aug 24 03:35:59.962461 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Host: 10.222.0.81 Aug 24 03:35:59.962461 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Openstack-System-Scope: None Aug 24 03:35:59.962461 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: User-Agent: python-urllib3/1.26.11 Aug 24 03:35:59.962461 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Auth-Token: gAAAAABjBZtP_wpwR9Y3bAcDYGBOT0mwVsByRvMetP-LFXmeiOuOHDaCm33H67I99DE_xaqBHlQVAXqo42-hQvceoTyzqUaUrREzwFCjB5uheciPzS-0oo6Dt1FFFg2gNgREWRC2xcQUJRjSVnFD9346HbvgMLQDPZu_rRgzBO_s4TcXYCjCPTI Aug 24 03:35:59.962461 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Id: None Aug 24 03:35:59.962461 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Name: None Aug 24 03:35:59.962461 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Identity-Status: Confirmed Aug 24 03:35:59.962461 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Is-Admin-Project: True Aug 24 03:35:59.962461 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Id: default Aug 24 03:35:59.962461 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Name: Default Aug 24 03:35:59.962461 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Id: 6a1e9994c1c045c892059d5b80578ba7 Aug 24 03:35:59.962461 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Name: tempest-AttachVolumeTestJSON-1807952205 Aug 24 03:35:59.962461 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Role: reader,member Aug 24 03:35:59.962461 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Roles: reader,member Aug 24 03:35:59.963989 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6a1e9994c1c045c892059d5b80578ba7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6a1e9994c1c045c892059d5b80578ba7", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6a1e9994c1c045c892059d5b80578ba7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6a1e9994c1c045c892059d5b80578ba7"}]}] Aug 24 03:35:59.963989 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant: tempest-AttachVolumeTestJSON-1807952205 Aug 24 03:35:59.963989 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Id: 6a1e9994c1c045c892059d5b80578ba7 Aug 24 03:35:59.963989 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1807952205 Aug 24 03:35:59.963989 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User: tempest-AttachVolumeTestJSON-1807952205-project Aug 24 03:35:59.963989 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Id: default Aug 24 03:35:59.963989 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Name: Default Aug 24 03:35:59.963989 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Id: 66900b813b934514a7920ba975a05ec5 Aug 24 03:35:59.963989 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Name: tempest-AttachVolumeTestJSON-1807952205-project Aug 24 03:35:59.963989 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: method: > Aug 24 03:35:59.963989 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: exception: Instance 9b97b3d6-5022-46c8-a189-fed177d028c8 could not be found. Aug 24 03:35:59.963989 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: action_args: {'id': '9b97b3d6-5022-46c8-a189-fed177d028c8'} Aug 24 03:35:59.968730 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:35:59.968730 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:59.968730 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:35:59.968730 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:35:59.968730 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:35:59.968730 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:35:59.968730 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:35:59.968730 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:35:59.968730 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:35:59.968730 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:35:59.968730 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b97b3d6-5022-46c8-a189-fed177d028c8 could not be found. Aug 24 03:35:59.968730 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:35:59.968730 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:59.968730 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:35:59.968730 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:59.968730 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:59.968730 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:59.968730 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:35:59.968730 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:35:59.968730 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:35:59.970689 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:35:59.970689 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:35:59.970689 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:35:59.970689 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:35:59.970689 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:35:59.970689 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:35:59.970689 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:35:59.970689 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:35:59.970689 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:35:59.970689 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b97b3d6-5022-46c8-a189-fed177d028c8 could not be found. Aug 24 03:35:59.970689 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:35:59.970689 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:35:59.970689 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:35:59.970689 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:35:59.970689 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:35:59.970689 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:35:59.970689 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:35:59.970689 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:35:59.970689 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b97b3d6-5022-46c8-a189-fed177d028c8 could not be found. Aug 24 03:35:59.970689 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:35:59.972285 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-e50779f5-ca4b-4e65-8798-f7cc1a748a86 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Returning 404 to user: Instance 9b97b3d6-5022-46c8-a189-fed177d028c8 could not be found. {{(pid=120709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:35:59.972285 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-e50779f5-ca4b-4e65-8798-f7cc1a748a86 tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "DELETE /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 404 len: 111 microversion: 2.1 time: 0.031075 Aug 24 03:35:59.972285 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 322/632] 10.222.0.81 () {58 vars in 1239 bytes} [Wed Aug 24 03:35:59 2022] DELETE /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:35:59.973239 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-bef6d115-90b0-4d2f-a973-5d07ee2bf32b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:59.973887 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-bef6d115-90b0-4d2f-a973-5d07ee2bf32b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] [instance: 9b97b3d6-5022-46c8-a189-fed177d028c8] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:59.975837 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-0a43f972-044e-48e2-a667-98e3f6d3a906 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Flavor limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:35:59.976306 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-0a43f972-044e-48e2-a667-98e3f6d3a906 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Image limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:35:59.976726 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-0a43f972-044e-48e2-a667-98e3f6d3a906 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Flavor pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:35:59.977209 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-0a43f972-044e-48e2-a667-98e3f6d3a906 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Image pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:35:59.977622 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-0a43f972-044e-48e2-a667-98e3f6d3a906 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:35:59.980033 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bef6d115-90b0-4d2f-a973-5d07ee2bf32b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:59.980533 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bef6d115-90b0-4d2f-a973-5d07ee2bf32b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:59.981006 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bef6d115-90b0-4d2f-a973-5d07ee2bf32b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:59.981713 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bef6d115-90b0-4d2f-a973-5d07ee2bf32b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:59.982170 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bef6d115-90b0-4d2f-a973-5d07ee2bf32b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:59.982597 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bef6d115-90b0-4d2f-a973-5d07ee2bf32b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:59.987376 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0a43f972-044e-48e2-a667-98e3f6d3a906 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:59.987855 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0a43f972-044e-48e2-a667-98e3f6d3a906 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:59.988287 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0a43f972-044e-48e2-a667-98e3f6d3a906 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:59.989040 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0a43f972-044e-48e2-a667-98e3f6d3a906 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:59.989491 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0a43f972-044e-48e2-a667-98e3f6d3a906 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:59.989909 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0a43f972-044e-48e2-a667-98e3f6d3a906 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:59.999175 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.wsgi [None req-bef6d115-90b0-4d2f-a973-5d07ee2bf32b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] HTTP exception thrown: Instance 9b97b3d6-5022-46c8-a189-fed177d028c8 could not be found. Aug 24 03:36:00.000701 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-bef6d115-90b0-4d2f-a973-5d07ee2bf32b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Request method failure captured: Aug 24 03:36:00.000701 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: request: GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 HTTP/1.1 Aug 24 03:36:00.000701 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept: application/json Aug 24 03:36:00.000701 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept-Encoding: identity Aug 24 03:36:00.000701 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Connection: close Aug 24 03:36:00.000701 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Length: 0 Aug 24 03:36:00.000701 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Type: application/json Aug 24 03:36:00.000701 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Host: 10.222.0.81 Aug 24 03:36:00.000701 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Openstack-System-Scope: None Aug 24 03:36:00.000701 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: User-Agent: python-urllib3/1.26.11 Aug 24 03:36:00.000701 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Auth-Token: gAAAAABjBZtP_wpwR9Y3bAcDYGBOT0mwVsByRvMetP-LFXmeiOuOHDaCm33H67I99DE_xaqBHlQVAXqo42-hQvceoTyzqUaUrREzwFCjB5uheciPzS-0oo6Dt1FFFg2gNgREWRC2xcQUJRjSVnFD9346HbvgMLQDPZu_rRgzBO_s4TcXYCjCPTI Aug 24 03:36:00.000701 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Id: None Aug 24 03:36:00.000701 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Name: None Aug 24 03:36:00.000701 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Identity-Status: Confirmed Aug 24 03:36:00.000701 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Is-Admin-Project: True Aug 24 03:36:00.000701 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Id: default Aug 24 03:36:00.000701 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Name: Default Aug 24 03:36:00.000701 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Id: 6a1e9994c1c045c892059d5b80578ba7 Aug 24 03:36:00.000701 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Name: tempest-AttachVolumeTestJSON-1807952205 Aug 24 03:36:00.000701 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Role: reader,member Aug 24 03:36:00.000701 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Roles: reader,member Aug 24 03:36:00.001985 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6a1e9994c1c045c892059d5b80578ba7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_6a1e9994c1c045c892059d5b80578ba7", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/6a1e9994c1c045c892059d5b80578ba7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/6a1e9994c1c045c892059d5b80578ba7"}]}] Aug 24 03:36:00.001985 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant: tempest-AttachVolumeTestJSON-1807952205 Aug 24 03:36:00.001985 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Id: 6a1e9994c1c045c892059d5b80578ba7 Aug 24 03:36:00.001985 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1807952205 Aug 24 03:36:00.001985 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User: tempest-AttachVolumeTestJSON-1807952205-project Aug 24 03:36:00.001985 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Id: default Aug 24 03:36:00.001985 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Name: Default Aug 24 03:36:00.001985 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Id: 66900b813b934514a7920ba975a05ec5 Aug 24 03:36:00.001985 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Name: tempest-AttachVolumeTestJSON-1807952205-project Aug 24 03:36:00.001985 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: method: > Aug 24 03:36:00.001985 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: exception: Instance 9b97b3d6-5022-46c8-a189-fed177d028c8 could not be found. Aug 24 03:36:00.001985 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: action_args: {'id': '9b97b3d6-5022-46c8-a189-fed177d028c8'} Aug 24 03:36:00.002675 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:36:00.002675 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:00.002675 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:36:00.002675 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:36:00.002675 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:36:00.002675 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:36:00.002675 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:36:00.002675 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:36:00.002675 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:36:00.002675 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:36:00.002675 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b97b3d6-5022-46c8-a189-fed177d028c8 could not be found. Aug 24 03:36:00.002675 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:36:00.002675 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:00.002675 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:36:00.002675 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:00.002675 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:36:00.002675 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:36:00.002675 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:36:00.002675 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:36:00.002675 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:36:00.003841 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:36:00.003841 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:36:00.003841 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:36:00.003841 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:36:00.003841 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:36:00.003841 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:36:00.003841 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:36:00.003841 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b97b3d6-5022-46c8-a189-fed177d028c8 could not be found. Aug 24 03:36:00.003841 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:36:00.003841 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:36:00.003841 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:36:00.003841 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:36:00.003841 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:36:00.003841 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:36:00.003841 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:36:00.003841 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:36:00.003841 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b97b3d6-5022-46c8-a189-fed177d028c8 could not be found. Aug 24 03:36:00.003841 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:36:00.004893 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-bef6d115-90b0-4d2f-a973-5d07ee2bf32b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] Returning 404 to user: Instance 9b97b3d6-5022-46c8-a189-fed177d028c8 could not be found. {{(pid=120709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:36:00.004893 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-bef6d115-90b0-4d2f-a973-5d07ee2bf32b tempest-AttachVolumeTestJSON-1807952205 tempest-AttachVolumeTestJSON-1807952205-project] 10.222.0.81 "GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8" status: 404 len: 111 microversion: 2.1 time: 0.032783 Aug 24 03:36:00.004893 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 323/633] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:59 2022] GET /compute/v2.1/servers/9b97b3d6-5022-46c8-a189-fed177d028c8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:36:00.006818 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-0a43f972-044e-48e2-a667-98e3f6d3a906 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Getting quotas for project 5dea7fb32dea4f75917d82973bf7e7e6. Resources: {'ram', 'instances', 'cores'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:36:00.010727 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-0a43f972-044e-48e2-a667-98e3f6d3a906 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Getting quotas for user e5588121cc364d30a8f01d17c4cfc6df and project 5dea7fb32dea4f75917d82973bf7e7e6. Resources: {'ram', 'instances', 'cores'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:36:00.068748 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0a43f972-044e-48e2-a667-98e3f6d3a906 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Going to run 1 instances... {{(pid=120708) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:36:00.071535 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0a43f972-044e-48e2-a667-98e3f6d3a906 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='baf9899d-5bdb-4835-ba62-880e9a3943a5',volume_size=None,volume_type=None)] {{(pid=120708) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:36:00.206529 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0a43f972-044e-48e2-a667-98e3f6d3a906 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.823447 Aug 24 03:36:00.207480 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 311/634] 10.222.0.81 () {60 vars in 1147 bytes} [Wed Aug 24 03:35:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:36:00.219342 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-d5c82cab-212f-4fca-afda-fcfbf24c6f7e tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:00.219962 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-d5c82cab-212f-4fca-afda-fcfbf24c6f7e tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:00.317482 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-d5c82cab-212f-4fca-afda-fcfbf24c6f7e tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:00.325395 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-d5c82cab-212f-4fca-afda-fcfbf24c6f7e tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1088 microversion: 2.1 time: 0.110571 Aug 24 03:36:00.326202 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 324/635] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:00 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1088 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:01.348348 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-5f5d34ec-d799-4a01-8402-1ad0890c509b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:01.348918 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-5f5d34ec-d799-4a01-8402-1ad0890c509b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:01.356188 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5f5d34ec-d799-4a01-8402-1ad0890c509b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:01.356678 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5f5d34ec-d799-4a01-8402-1ad0890c509b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:01.358352 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5f5d34ec-d799-4a01-8402-1ad0890c509b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:01.359103 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5f5d34ec-d799-4a01-8402-1ad0890c509b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:01.359569 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5f5d34ec-d799-4a01-8402-1ad0890c509b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:01.359998 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5f5d34ec-d799-4a01-8402-1ad0890c509b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:01.432876 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-5f5d34ec-d799-4a01-8402-1ad0890c509b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:01.441632 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-5f5d34ec-d799-4a01-8402-1ad0890c509b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1130 microversion: 2.1 time: 0.097779 Aug 24 03:36:01.442387 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 312/636] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:01 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1130 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:02.462968 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-d1e08cfc-c949-4fc6-bb07-919accb23cd5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:02.463803 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-d1e08cfc-c949-4fc6-bb07-919accb23cd5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:02.473749 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d1e08cfc-c949-4fc6-bb07-919accb23cd5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:02.474249 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d1e08cfc-c949-4fc6-bb07-919accb23cd5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:02.474719 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d1e08cfc-c949-4fc6-bb07-919accb23cd5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:02.475436 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d1e08cfc-c949-4fc6-bb07-919accb23cd5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:02.475990 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d1e08cfc-c949-4fc6-bb07-919accb23cd5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:02.476419 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d1e08cfc-c949-4fc6-bb07-919accb23cd5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:02.546740 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-d1e08cfc-c949-4fc6-bb07-919accb23cd5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:02.554115 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-d1e08cfc-c949-4fc6-bb07-919accb23cd5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1130 microversion: 2.1 time: 0.094939 Aug 24 03:36:02.554834 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 325/637] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:02 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1130 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:03.575731 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-6668e93f-4e02-46c9-b78c-42708c9cb7ba tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:03.576559 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-6668e93f-4e02-46c9-b78c-42708c9cb7ba tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:03.583497 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6668e93f-4e02-46c9-b78c-42708c9cb7ba tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:03.584384 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6668e93f-4e02-46c9-b78c-42708c9cb7ba tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:03.585015 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6668e93f-4e02-46c9-b78c-42708c9cb7ba tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:03.585808 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6668e93f-4e02-46c9-b78c-42708c9cb7ba tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:03.586271 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6668e93f-4e02-46c9-b78c-42708c9cb7ba tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:03.586985 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6668e93f-4e02-46c9-b78c-42708c9cb7ba tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:03.661215 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-6668e93f-4e02-46c9-b78c-42708c9cb7ba tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:03.670740 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-6668e93f-4e02-46c9-b78c-42708c9cb7ba tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1186 microversion: 2.1 time: 0.099482 Aug 24 03:36:03.671354 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 313/638] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:03 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1186 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:04.697056 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-bbccf43f-33f8-4c0a-9bcd-317e32769b43 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:04.699338 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-bbccf43f-33f8-4c0a-9bcd-317e32769b43 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:04.710502 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bbccf43f-33f8-4c0a-9bcd-317e32769b43 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:04.711179 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bbccf43f-33f8-4c0a-9bcd-317e32769b43 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:04.711800 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bbccf43f-33f8-4c0a-9bcd-317e32769b43 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:04.712982 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bbccf43f-33f8-4c0a-9bcd-317e32769b43 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:04.713602 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bbccf43f-33f8-4c0a-9bcd-317e32769b43 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:04.715051 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bbccf43f-33f8-4c0a-9bcd-317e32769b43 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:04.924194 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-bbccf43f-33f8-4c0a-9bcd-317e32769b43 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:04.937927 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-bbccf43f-33f8-4c0a-9bcd-317e32769b43 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1271 microversion: 2.1 time: 0.245295 Aug 24 03:36:04.941842 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 326/639] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:04 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1271 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:05.543245 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-43f6cfa8-37d9-4fd1-8055-458cfc21e04f req-f10cd13d-b2a9-41d8-b46b-f70a454cc090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ee318a0-695b-431d-98cc-0d21560a2508", "tag": "b8c721ca-e1f1-4111-b00e-57a5d43c8885"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:05.555434 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-43f6cfa8-37d9-4fd1-8055-458cfc21e04f req-f10cd13d-b2a9-41d8-b46b-f70a454cc090 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:05.555990 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-43f6cfa8-37d9-4fd1-8055-458cfc21e04f req-f10cd13d-b2a9-41d8-b46b-f70a454cc090 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:05.556422 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-43f6cfa8-37d9-4fd1-8055-458cfc21e04f req-f10cd13d-b2a9-41d8-b46b-f70a454cc090 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:05.568133 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-43f6cfa8-37d9-4fd1-8055-458cfc21e04f req-f10cd13d-b2a9-41d8-b46b-f70a454cc090 service nova] Creating event network-changed:b8c721ca-e1f1-4111-b00e-57a5d43c8885 for instance 7ee318a0-695b-431d-98cc-0d21560a2508 on hv-cinder-85426 Aug 24 03:36:05.580006 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-43f6cfa8-37d9-4fd1-8055-458cfc21e04f req-f10cd13d-b2a9-41d8-b46b-f70a454cc090 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043516 Aug 24 03:36:05.580608 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 314/640] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:36:05.964041 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-0e2740eb-54e4-46ab-a77f-4791a6bc74c8 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:05.966794 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-0e2740eb-54e4-46ab-a77f-4791a6bc74c8 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:05.974537 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0e2740eb-54e4-46ab-a77f-4791a6bc74c8 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:05.975449 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0e2740eb-54e4-46ab-a77f-4791a6bc74c8 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:05.976128 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0e2740eb-54e4-46ab-a77f-4791a6bc74c8 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:05.977767 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0e2740eb-54e4-46ab-a77f-4791a6bc74c8 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:05.978374 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0e2740eb-54e4-46ab-a77f-4791a6bc74c8 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:05.978967 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0e2740eb-54e4-46ab-a77f-4791a6bc74c8 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:06.127291 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-0e2740eb-54e4-46ab-a77f-4791a6bc74c8 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:06.135129 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-0e2740eb-54e4-46ab-a77f-4791a6bc74c8 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1259 microversion: 2.1 time: 0.176204 Aug 24 03:36:06.135701 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 327/641] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:05 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:07.162001 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c7af4b4f-8461-4e83-a0e1-ac4605efc9ec tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:07.164429 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c7af4b4f-8461-4e83-a0e1-ac4605efc9ec tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:07.173955 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c7af4b4f-8461-4e83-a0e1-ac4605efc9ec tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:07.174732 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c7af4b4f-8461-4e83-a0e1-ac4605efc9ec tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:07.175167 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c7af4b4f-8461-4e83-a0e1-ac4605efc9ec tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:07.175861 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c7af4b4f-8461-4e83-a0e1-ac4605efc9ec tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:07.176307 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c7af4b4f-8461-4e83-a0e1-ac4605efc9ec tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:07.176833 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c7af4b4f-8461-4e83-a0e1-ac4605efc9ec tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:07.343056 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c7af4b4f-8461-4e83-a0e1-ac4605efc9ec tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:07.352587 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c7af4b4f-8461-4e83-a0e1-ac4605efc9ec tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1259 microversion: 2.1 time: 0.200509 Aug 24 03:36:07.353201 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 315/642] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:07 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1259 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:08.373742 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-f43351b2-a2e1-4e4c-92d6-e412fdc49e15 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:08.374969 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-f43351b2-a2e1-4e4c-92d6-e412fdc49e15 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:08.382503 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f43351b2-a2e1-4e4c-92d6-e412fdc49e15 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:08.382991 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f43351b2-a2e1-4e4c-92d6-e412fdc49e15 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:08.383644 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f43351b2-a2e1-4e4c-92d6-e412fdc49e15 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:08.384520 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f43351b2-a2e1-4e4c-92d6-e412fdc49e15 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:08.385185 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f43351b2-a2e1-4e4c-92d6-e412fdc49e15 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:08.385800 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f43351b2-a2e1-4e4c-92d6-e412fdc49e15 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:08.555153 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-f43351b2-a2e1-4e4c-92d6-e412fdc49e15 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:08.566821 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-f43351b2-a2e1-4e4c-92d6-e412fdc49e15 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1259 microversion: 2.1 time: 0.196415 Aug 24 03:36:08.567953 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 328/643] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:08 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1259 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:09.588251 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-17dfba00-6be0-4790-9205-8e9d1f1f9a0d tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:09.588984 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-17dfba00-6be0-4790-9205-8e9d1f1f9a0d tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:09.599958 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-17dfba00-6be0-4790-9205-8e9d1f1f9a0d tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:09.600463 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-17dfba00-6be0-4790-9205-8e9d1f1f9a0d tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:09.601033 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-17dfba00-6be0-4790-9205-8e9d1f1f9a0d tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:09.601806 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-17dfba00-6be0-4790-9205-8e9d1f1f9a0d tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:09.602207 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-17dfba00-6be0-4790-9205-8e9d1f1f9a0d tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:09.602775 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-17dfba00-6be0-4790-9205-8e9d1f1f9a0d tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:09.786183 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-17dfba00-6be0-4790-9205-8e9d1f1f9a0d tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:09.795786 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-17dfba00-6be0-4790-9205-8e9d1f1f9a0d tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1259 microversion: 2.1 time: 0.212059 Aug 24 03:36:09.796362 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 316/644] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:09 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1259 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:10.817772 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-a86fef74-1215-4e4b-bbb1-794f7860c3bf tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:10.818315 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-a86fef74-1215-4e4b-bbb1-794f7860c3bf tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:10.820837 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell0:SELECT=2 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:10.827414 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a86fef74-1215-4e4b-bbb1-794f7860c3bf tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:10.827914 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a86fef74-1215-4e4b-bbb1-794f7860c3bf tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:10.828355 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a86fef74-1215-4e4b-bbb1-794f7860c3bf tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:10.829110 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a86fef74-1215-4e4b-bbb1-794f7860c3bf tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:10.829567 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a86fef74-1215-4e4b-bbb1-794f7860c3bf tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:10.829998 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a86fef74-1215-4e4b-bbb1-794f7860c3bf tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:10.878477 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-18704ecf-d550-4e91-9a1a-b5d12612b22f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:10.879028 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-18704ecf-d550-4e91-9a1a-b5d12612b22f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:10.881942 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=2 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:10.882856 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=6 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:10.888676 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-18704ecf-d550-4e91-9a1a-b5d12612b22f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:10.889195 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-18704ecf-d550-4e91-9a1a-b5d12612b22f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:10.894827 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-18704ecf-d550-4e91-9a1a-b5d12612b22f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:10.895560 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-18704ecf-d550-4e91-9a1a-b5d12612b22f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:10.896178 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-18704ecf-d550-4e91-9a1a-b5d12612b22f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:10.896823 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-18704ecf-d550-4e91-9a1a-b5d12612b22f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:10.930645 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-18704ecf-d550-4e91-9a1a-b5d12612b22f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4/ips" status: 200 len: 153 microversion: 2.20 time: 0.058099 Aug 24 03:36:10.931226 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 317/645] 10.222.0.81 () {60 vars in 1289 bytes} [Wed Aug 24 03:36:10 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4/ips => generated 153 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:36:10.974029 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-a86fef74-1215-4e4b-bbb1-794f7860c3bf tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:10.984006 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-a86fef74-1215-4e4b-bbb1-794f7860c3bf tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1259 microversion: 2.1 time: 0.170263 Aug 24 03:36:10.984737 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 329/646] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:10 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:12.005963 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-67642ebe-21eb-47e6-93cb-fb1ad074cad9 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:12.006726 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-67642ebe-21eb-47e6-93cb-fb1ad074cad9 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:12.013400 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-67642ebe-21eb-47e6-93cb-fb1ad074cad9 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:12.014021 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-67642ebe-21eb-47e6-93cb-fb1ad074cad9 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:12.014514 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-67642ebe-21eb-47e6-93cb-fb1ad074cad9 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:12.015291 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-67642ebe-21eb-47e6-93cb-fb1ad074cad9 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:12.015814 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-67642ebe-21eb-47e6-93cb-fb1ad074cad9 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:12.016306 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-67642ebe-21eb-47e6-93cb-fb1ad074cad9 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:12.168918 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-67642ebe-21eb-47e6-93cb-fb1ad074cad9 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:12.177509 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-67642ebe-21eb-47e6-93cb-fb1ad074cad9 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1259 microversion: 2.1 time: 0.175447 Aug 24 03:36:12.178075 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 318/647] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:12 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:12.801903 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-09a82302-7b5a-4fe4-8351-f3f025b371a2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:12.802745 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-09a82302-7b5a-4fe4-8351-f3f025b371a2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:12.810939 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-09a82302-7b5a-4fe4-8351-f3f025b371a2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:12.811811 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-09a82302-7b5a-4fe4-8351-f3f025b371a2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:12.812245 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-09a82302-7b5a-4fe4-8351-f3f025b371a2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:12.812982 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-09a82302-7b5a-4fe4-8351-f3f025b371a2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:12.813618 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-09a82302-7b5a-4fe4-8351-f3f025b371a2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:12.814042 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-09a82302-7b5a-4fe4-8351-f3f025b371a2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:12.837349 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.objects.instance [None req-09a82302-7b5a-4fe4-8351-f3f025b371a2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lazy-loading 'flavor' on Instance uuid a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 {{(pid=120709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:36:12.877456 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:13.031087 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-09a82302-7b5a-4fe4-8351-f3f025b371a2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "POST /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4/action" status: 202 len: 0 microversion: 2.20 time: 0.233878 Aug 24 03:36:13.031676 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 330/648] 10.222.0.81 () {62 vars in 1319 bytes} [Wed Aug 24 03:36:12 2022] POST /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:36:13.040506 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7896e0c1-9627-4fb4-80b0-f44e735b2056 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:13.042636 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-7896e0c1-9627-4fb4-80b0-f44e735b2056 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:13.054151 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7896e0c1-9627-4fb4-80b0-f44e735b2056 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:13.054151 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7896e0c1-9627-4fb4-80b0-f44e735b2056 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:13.054151 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7896e0c1-9627-4fb4-80b0-f44e735b2056 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:13.054151 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7896e0c1-9627-4fb4-80b0-f44e735b2056 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:13.054515 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7896e0c1-9627-4fb4-80b0-f44e735b2056 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:13.054515 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7896e0c1-9627-4fb4-80b0-f44e735b2056 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:13.187031 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-7896e0c1-9627-4fb4-80b0-f44e735b2056 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:13.195453 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-7896e0c1-9627-4fb4-80b0-f44e735b2056 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:13.197224 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-7896e0c1-9627-4fb4-80b0-f44e735b2056 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:13.199009 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-7896e0c1-9627-4fb4-80b0-f44e735b2056 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1726 microversion: 2.20 time: 0.162259 Aug 24 03:36:13.199684 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-5308b944-beac-4974-ae90-4abe83119892 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:13.200005 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 319/649] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:13 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:13.200673 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-5308b944-beac-4974-ae90-4abe83119892 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:13.206560 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:13.208136 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5308b944-beac-4974-ae90-4abe83119892 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:13.208678 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5308b944-beac-4974-ae90-4abe83119892 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:13.209181 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5308b944-beac-4974-ae90-4abe83119892 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:13.210239 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5308b944-beac-4974-ae90-4abe83119892 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:13.210853 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5308b944-beac-4974-ae90-4abe83119892 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:13.211453 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5308b944-beac-4974-ae90-4abe83119892 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:13.351355 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-5308b944-beac-4974-ae90-4abe83119892 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:13.359855 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-5308b944-beac-4974-ae90-4abe83119892 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1259 microversion: 2.1 time: 0.164617 Aug 24 03:36:13.360418 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 331/650] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:13 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:14.224398 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-6003ab96-ee28-4a18-9f26-80e985a32321 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:14.225052 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-6003ab96-ee28-4a18-9f26-80e985a32321 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:14.232669 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6003ab96-ee28-4a18-9f26-80e985a32321 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:14.233180 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6003ab96-ee28-4a18-9f26-80e985a32321 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:14.233616 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6003ab96-ee28-4a18-9f26-80e985a32321 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:14.234307 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6003ab96-ee28-4a18-9f26-80e985a32321 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:14.234758 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6003ab96-ee28-4a18-9f26-80e985a32321 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:14.235276 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6003ab96-ee28-4a18-9f26-80e985a32321 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:14.364841 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-6003ab96-ee28-4a18-9f26-80e985a32321 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:14.373244 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-6003ab96-ee28-4a18-9f26-80e985a32321 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:14.374753 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-6003ab96-ee28-4a18-9f26-80e985a32321 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:14.375912 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-6003ab96-ee28-4a18-9f26-80e985a32321 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1726 microversion: 2.20 time: 0.155452 Aug 24 03:36:14.376472 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 320/651] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:14 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:14.380844 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-b7d0c005-6de5-4299-9337-ac42033aad07 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:14.381467 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-b7d0c005-6de5-4299-9337-ac42033aad07 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:14.387813 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b7d0c005-6de5-4299-9337-ac42033aad07 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:14.388299 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b7d0c005-6de5-4299-9337-ac42033aad07 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:14.388740 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b7d0c005-6de5-4299-9337-ac42033aad07 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:14.389456 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b7d0c005-6de5-4299-9337-ac42033aad07 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:14.389917 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b7d0c005-6de5-4299-9337-ac42033aad07 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:14.390350 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b7d0c005-6de5-4299-9337-ac42033aad07 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:14.519881 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-b7d0c005-6de5-4299-9337-ac42033aad07 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:14.528023 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-b7d0c005-6de5-4299-9337-ac42033aad07 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1259 microversion: 2.1 time: 0.151019 Aug 24 03:36:14.528578 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 332/652] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:14 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:15.399364 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d19e7ce4-ae99-4d2b-b398-badd84bc5e2f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:15.400000 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d19e7ce4-ae99-4d2b-b398-badd84bc5e2f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:15.406031 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d19e7ce4-ae99-4d2b-b398-badd84bc5e2f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:15.406517 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d19e7ce4-ae99-4d2b-b398-badd84bc5e2f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:15.406961 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d19e7ce4-ae99-4d2b-b398-badd84bc5e2f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:15.407658 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d19e7ce4-ae99-4d2b-b398-badd84bc5e2f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:15.408118 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d19e7ce4-ae99-4d2b-b398-badd84bc5e2f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:15.408555 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d19e7ce4-ae99-4d2b-b398-badd84bc5e2f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:15.549861 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-b6ad850b-6ddb-46c7-9767-28d8d39765c5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:15.550569 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-b6ad850b-6ddb-46c7-9767-28d8d39765c5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:15.558095 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b6ad850b-6ddb-46c7-9767-28d8d39765c5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:15.558994 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b6ad850b-6ddb-46c7-9767-28d8d39765c5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:15.559115 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d19e7ce4-ae99-4d2b-b398-badd84bc5e2f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:15.559435 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b6ad850b-6ddb-46c7-9767-28d8d39765c5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:15.560424 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b6ad850b-6ddb-46c7-9767-28d8d39765c5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:15.560914 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b6ad850b-6ddb-46c7-9767-28d8d39765c5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:15.561512 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b6ad850b-6ddb-46c7-9767-28d8d39765c5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:15.567348 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d19e7ce4-ae99-4d2b-b398-badd84bc5e2f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:15.568893 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d19e7ce4-ae99-4d2b-b398-badd84bc5e2f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:15.570059 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d19e7ce4-ae99-4d2b-b398-badd84bc5e2f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1726 microversion: 2.20 time: 0.174568 Aug 24 03:36:15.570619 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 321/653] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:15 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1726 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:15.708187 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-b6ad850b-6ddb-46c7-9767-28d8d39765c5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:15.716578 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-b6ad850b-6ddb-46c7-9767-28d8d39765c5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1259 microversion: 2.1 time: 0.171850 Aug 24 03:36:15.717528 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 333/654] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:15 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:16.595411 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-f9466c2e-a1d8-4317-89c7-f8cc9c03e00c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:16.596099 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-f9466c2e-a1d8-4317-89c7-f8cc9c03e00c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:16.606970 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f9466c2e-a1d8-4317-89c7-f8cc9c03e00c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:16.608110 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f9466c2e-a1d8-4317-89c7-f8cc9c03e00c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:16.608110 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f9466c2e-a1d8-4317-89c7-f8cc9c03e00c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:16.608654 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f9466c2e-a1d8-4317-89c7-f8cc9c03e00c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:16.609247 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f9466c2e-a1d8-4317-89c7-f8cc9c03e00c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:16.609583 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f9466c2e-a1d8-4317-89c7-f8cc9c03e00c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:16.648343 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-6d04e76b-9f2f-4613-9c92-a06ae8e9c738 req-eb6c18e1-78ae-41be-b3e9-4614124b9298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee318a0-695b-431d-98cc-0d21560a2508", "name": "network-vif-plugged", "status": "completed", "tag": "b8c721ca-e1f1-4111-b00e-57a5d43c8885"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:16.660111 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-6d04e76b-9f2f-4613-9c92-a06ae8e9c738 req-eb6c18e1-78ae-41be-b3e9-4614124b9298 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:16.660703 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-6d04e76b-9f2f-4613-9c92-a06ae8e9c738 req-eb6c18e1-78ae-41be-b3e9-4614124b9298 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:16.661356 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-6d04e76b-9f2f-4613-9c92-a06ae8e9c738 req-eb6c18e1-78ae-41be-b3e9-4614124b9298 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:16.678723 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-6d04e76b-9f2f-4613-9c92-a06ae8e9c738 req-eb6c18e1-78ae-41be-b3e9-4614124b9298 service nova] Creating event network-vif-plugged:b8c721ca-e1f1-4111-b00e-57a5d43c8885 for instance 7ee318a0-695b-431d-98cc-0d21560a2508 on hv-cinder-85426 Aug 24 03:36:16.685812 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-6d04e76b-9f2f-4613-9c92-a06ae8e9c738 req-eb6c18e1-78ae-41be-b3e9-4614124b9298 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206815 Aug 24 03:36:16.686606 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 322/655] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:36:16.739974 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a880644d-a5ef-4f1c-b750-f47a64f12401 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:16.740672 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a880644d-a5ef-4f1c-b750-f47a64f12401 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:16.751396 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a880644d-a5ef-4f1c-b750-f47a64f12401 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:16.751396 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a880644d-a5ef-4f1c-b750-f47a64f12401 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:16.751396 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a880644d-a5ef-4f1c-b750-f47a64f12401 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:16.751396 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a880644d-a5ef-4f1c-b750-f47a64f12401 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:16.751736 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a880644d-a5ef-4f1c-b750-f47a64f12401 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:16.751736 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a880644d-a5ef-4f1c-b750-f47a64f12401 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:16.797414 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-f9466c2e-a1d8-4317-89c7-f8cc9c03e00c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:16.808841 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-f9466c2e-a1d8-4317-89c7-f8cc9c03e00c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:16.811074 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-f9466c2e-a1d8-4317-89c7-f8cc9c03e00c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:16.812601 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-f9466c2e-a1d8-4317-89c7-f8cc9c03e00c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1726 microversion: 2.20 time: 0.222969 Aug 24 03:36:16.813471 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 334/656] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:16 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1726 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:36:16.972896 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a880644d-a5ef-4f1c-b750-f47a64f12401 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:16.994860 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a880644d-a5ef-4f1c-b750-f47a64f12401 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1259 microversion: 2.1 time: 0.258912 Aug 24 03:36:16.996158 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 323/657] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:16 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1259 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:17.837570 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-9d373e74-0aed-4bab-96d9-3fa29c0bcb7c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:17.838218 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-9d373e74-0aed-4bab-96d9-3fa29c0bcb7c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:17.845950 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9d373e74-0aed-4bab-96d9-3fa29c0bcb7c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:17.846444 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9d373e74-0aed-4bab-96d9-3fa29c0bcb7c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:17.846893 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9d373e74-0aed-4bab-96d9-3fa29c0bcb7c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:17.847596 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9d373e74-0aed-4bab-96d9-3fa29c0bcb7c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:17.848063 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9d373e74-0aed-4bab-96d9-3fa29c0bcb7c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:17.848491 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9d373e74-0aed-4bab-96d9-3fa29c0bcb7c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:18.011325 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-9d373e74-0aed-4bab-96d9-3fa29c0bcb7c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:18.018405 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-edd476d9-5536-4481-a7c4-e109f8853f7e tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:18.019018 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-edd476d9-5536-4481-a7c4-e109f8853f7e tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:18.023042 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-9d373e74-0aed-4bab-96d9-3fa29c0bcb7c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:18.024952 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-9d373e74-0aed-4bab-96d9-3fa29c0bcb7c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:18.026425 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-9d373e74-0aed-4bab-96d9-3fa29c0bcb7c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1726 microversion: 2.20 time: 0.192656 Aug 24 03:36:18.026970 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-edd476d9-5536-4481-a7c4-e109f8853f7e tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:18.027893 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 335/658] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:17 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1726 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:18.036321 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-edd476d9-5536-4481-a7c4-e109f8853f7e tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:18.036811 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-edd476d9-5536-4481-a7c4-e109f8853f7e tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:18.044360 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-edd476d9-5536-4481-a7c4-e109f8853f7e tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:18.045070 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-edd476d9-5536-4481-a7c4-e109f8853f7e tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:18.045746 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-edd476d9-5536-4481-a7c4-e109f8853f7e tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:18.204460 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-edd476d9-5536-4481-a7c4-e109f8853f7e tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:18.211945 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-edd476d9-5536-4481-a7c4-e109f8853f7e tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1259 microversion: 2.1 time: 0.198264 Aug 24 03:36:18.212500 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 324/659] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:18 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1259 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:19.052019 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-eeafef7b-28de-454a-9879-615e4cca0159 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:19.053355 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-eeafef7b-28de-454a-9879-615e4cca0159 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:19.060418 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-eeafef7b-28de-454a-9879-615e4cca0159 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:19.061216 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-eeafef7b-28de-454a-9879-615e4cca0159 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:19.061664 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-eeafef7b-28de-454a-9879-615e4cca0159 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:19.062369 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-eeafef7b-28de-454a-9879-615e4cca0159 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:19.062829 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-eeafef7b-28de-454a-9879-615e4cca0159 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:19.063292 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-eeafef7b-28de-454a-9879-615e4cca0159 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:19.212462 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-eeafef7b-28de-454a-9879-615e4cca0159 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:19.221627 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-eeafef7b-28de-454a-9879-615e4cca0159 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:19.223205 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-eeafef7b-28de-454a-9879-615e4cca0159 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:19.226059 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-eeafef7b-28de-454a-9879-615e4cca0159 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1726 microversion: 2.20 time: 0.178795 Aug 24 03:36:19.226635 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 336/660] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:19 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1726 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:19.241578 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f0134020-925e-4c49-b49e-8df9ba7575f8 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:19.242313 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f0134020-925e-4c49-b49e-8df9ba7575f8 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:19.251531 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f0134020-925e-4c49-b49e-8df9ba7575f8 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:19.252295 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f0134020-925e-4c49-b49e-8df9ba7575f8 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:19.252931 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f0134020-925e-4c49-b49e-8df9ba7575f8 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:19.253634 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f0134020-925e-4c49-b49e-8df9ba7575f8 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:19.254832 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f0134020-925e-4c49-b49e-8df9ba7575f8 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:19.255524 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f0134020-925e-4c49-b49e-8df9ba7575f8 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:19.395058 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f0134020-925e-4c49-b49e-8df9ba7575f8 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:19.403578 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f0134020-925e-4c49-b49e-8df9ba7575f8 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1444 microversion: 2.1 time: 0.168644 Aug 24 03:36:19.404150 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 325/661] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:19 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1444 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:19.424298 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-4ca23a87-4873-4b4d-b8d6-366b4e891703 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:19.424955 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-4ca23a87-4873-4b4d-b8d6-366b4e891703 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:19.431015 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4ca23a87-4873-4b4d-b8d6-366b4e891703 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:19.431932 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4ca23a87-4873-4b4d-b8d6-366b4e891703 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:19.433011 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4ca23a87-4873-4b4d-b8d6-366b4e891703 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:19.434358 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4ca23a87-4873-4b4d-b8d6-366b4e891703 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:19.434961 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4ca23a87-4873-4b4d-b8d6-366b4e891703 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:19.435648 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4ca23a87-4873-4b4d-b8d6-366b4e891703 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:19.576027 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-4ca23a87-4873-4b4d-b8d6-366b4e891703 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:19.590045 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-4ca23a87-4873-4b4d-b8d6-366b4e891703 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1444 microversion: 2.1 time: 0.169454 Aug 24 03:36:19.590642 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 337/662] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:19 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1444 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:20.251863 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ca8787e1-b096-4896-9df5-114e49a1a6b3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:20.252505 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ca8787e1-b096-4896-9df5-114e49a1a6b3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:20.254973 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:20.260033 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ca8787e1-b096-4896-9df5-114e49a1a6b3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:20.260946 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ca8787e1-b096-4896-9df5-114e49a1a6b3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:20.261343 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ca8787e1-b096-4896-9df5-114e49a1a6b3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:20.262100 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ca8787e1-b096-4896-9df5-114e49a1a6b3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:20.262555 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ca8787e1-b096-4896-9df5-114e49a1a6b3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:20.262973 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ca8787e1-b096-4896-9df5-114e49a1a6b3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:20.268426 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=99 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:20.571665 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ca8787e1-b096-4896-9df5-114e49a1a6b3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:20.587156 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ca8787e1-b096-4896-9df5-114e49a1a6b3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:20.589374 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ca8787e1-b096-4896-9df5-114e49a1a6b3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:20.590749 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ca8787e1-b096-4896-9df5-114e49a1a6b3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1726 microversion: 2.20 time: 0.343515 Aug 24 03:36:20.593679 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 326/663] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:20 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1726 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:21.618350 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-eab7edb7-aa95-4325-aa7a-90a44fe38ed1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:21.621276 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-eab7edb7-aa95-4325-aa7a-90a44fe38ed1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:21.631585 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eab7edb7-aa95-4325-aa7a-90a44fe38ed1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:21.632844 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eab7edb7-aa95-4325-aa7a-90a44fe38ed1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:21.633497 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eab7edb7-aa95-4325-aa7a-90a44fe38ed1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:21.635122 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eab7edb7-aa95-4325-aa7a-90a44fe38ed1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:21.636194 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eab7edb7-aa95-4325-aa7a-90a44fe38ed1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:21.636886 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eab7edb7-aa95-4325-aa7a-90a44fe38ed1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:21.805184 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-2e47808b-a120-472e-9148-08d5eb3023e1 req-339522b8-1f3a-40f6-b232-b02a3052da03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ee318a0-695b-431d-98cc-0d21560a2508", "tag": "b8c721ca-e1f1-4111-b00e-57a5d43c8885"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:21.806384 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-eab7edb7-aa95-4325-aa7a-90a44fe38ed1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:21.815557 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-2e47808b-a120-472e-9148-08d5eb3023e1 req-339522b8-1f3a-40f6-b232-b02a3052da03 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:21.816106 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-2e47808b-a120-472e-9148-08d5eb3023e1 req-339522b8-1f3a-40f6-b232-b02a3052da03 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:21.816281 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-eab7edb7-aa95-4325-aa7a-90a44fe38ed1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:21.816472 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-2e47808b-a120-472e-9148-08d5eb3023e1 req-339522b8-1f3a-40f6-b232-b02a3052da03 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:21.818233 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-eab7edb7-aa95-4325-aa7a-90a44fe38ed1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:21.819658 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-eab7edb7-aa95-4325-aa7a-90a44fe38ed1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1726 microversion: 2.20 time: 0.207775 Aug 24 03:36:21.820331 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 327/664] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:21 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1726 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:36:21.830763 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-2e47808b-a120-472e-9148-08d5eb3023e1 req-339522b8-1f3a-40f6-b232-b02a3052da03 service nova] Creating event network-changed:b8c721ca-e1f1-4111-b00e-57a5d43c8885 for instance 7ee318a0-695b-431d-98cc-0d21560a2508 on hv-cinder-85426 Aug 24 03:36:21.836693 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-2e47808b-a120-472e-9148-08d5eb3023e1 req-339522b8-1f3a-40f6-b232-b02a3052da03 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.279567 Aug 24 03:36:21.838159 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 338/665] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:36:22.843631 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0d2f9931-f795-4161-8e54-9d8a6aa5c97f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:22.844291 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0d2f9931-f795-4161-8e54-9d8a6aa5c97f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:22.850802 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0d2f9931-f795-4161-8e54-9d8a6aa5c97f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:22.851300 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0d2f9931-f795-4161-8e54-9d8a6aa5c97f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:22.851740 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0d2f9931-f795-4161-8e54-9d8a6aa5c97f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:22.852443 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0d2f9931-f795-4161-8e54-9d8a6aa5c97f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:22.852930 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0d2f9931-f795-4161-8e54-9d8a6aa5c97f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:22.853367 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0d2f9931-f795-4161-8e54-9d8a6aa5c97f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:22.987770 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0d2f9931-f795-4161-8e54-9d8a6aa5c97f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:22.996824 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0d2f9931-f795-4161-8e54-9d8a6aa5c97f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:22.998350 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0d2f9931-f795-4161-8e54-9d8a6aa5c97f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:22.999519 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0d2f9931-f795-4161-8e54-9d8a6aa5c97f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1726 microversion: 2.20 time: 0.160170 Aug 24 03:36:23.000074 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 328/666] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:22 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:24.023553 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-5bea8dfd-a45f-4b4f-9175-f4c0441510db tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:24.024379 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-5bea8dfd-a45f-4b4f-9175-f4c0441510db tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:24.030891 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5bea8dfd-a45f-4b4f-9175-f4c0441510db tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:24.031641 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5bea8dfd-a45f-4b4f-9175-f4c0441510db tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:24.032100 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5bea8dfd-a45f-4b4f-9175-f4c0441510db tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:24.032816 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5bea8dfd-a45f-4b4f-9175-f4c0441510db tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:24.033276 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5bea8dfd-a45f-4b4f-9175-f4c0441510db tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:24.033710 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5bea8dfd-a45f-4b4f-9175-f4c0441510db tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:24.197353 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-5bea8dfd-a45f-4b4f-9175-f4c0441510db tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:24.206218 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-5bea8dfd-a45f-4b4f-9175-f4c0441510db tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:24.208016 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-5bea8dfd-a45f-4b4f-9175-f4c0441510db tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:24.209256 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-5bea8dfd-a45f-4b4f-9175-f4c0441510db tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1726 microversion: 2.20 time: 0.190459 Aug 24 03:36:24.220845 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 339/667] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:24 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1726 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:36:25.235643 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4ffe26ee-2f9e-4f2e-ae85-d1d4e4d5dafc tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:25.236286 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-4ffe26ee-2f9e-4f2e-ae85-d1d4e4d5dafc tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:25.245134 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4ffe26ee-2f9e-4f2e-ae85-d1d4e4d5dafc tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:25.245629 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4ffe26ee-2f9e-4f2e-ae85-d1d4e4d5dafc tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:25.246067 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4ffe26ee-2f9e-4f2e-ae85-d1d4e4d5dafc tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:25.246763 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4ffe26ee-2f9e-4f2e-ae85-d1d4e4d5dafc tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:25.247316 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4ffe26ee-2f9e-4f2e-ae85-d1d4e4d5dafc tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:25.247751 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4ffe26ee-2f9e-4f2e-ae85-d1d4e4d5dafc tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:25.375316 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4ffe26ee-2f9e-4f2e-ae85-d1d4e4d5dafc tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:25.384689 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4ffe26ee-2f9e-4f2e-ae85-d1d4e4d5dafc tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:25.387841 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4ffe26ee-2f9e-4f2e-ae85-d1d4e4d5dafc tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:25.389497 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4ffe26ee-2f9e-4f2e-ae85-d1d4e4d5dafc tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1726 microversion: 2.20 time: 0.158491 Aug 24 03:36:25.390060 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 329/668] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:25 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:26.414358 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-c76f0be4-f145-4891-b778-a3e670ba7333 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:26.415742 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-c76f0be4-f145-4891-b778-a3e670ba7333 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:26.424503 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c76f0be4-f145-4891-b778-a3e670ba7333 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:26.424951 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c76f0be4-f145-4891-b778-a3e670ba7333 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:26.425749 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c76f0be4-f145-4891-b778-a3e670ba7333 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:26.426576 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c76f0be4-f145-4891-b778-a3e670ba7333 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:26.427065 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c76f0be4-f145-4891-b778-a3e670ba7333 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:26.427638 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c76f0be4-f145-4891-b778-a3e670ba7333 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:26.592215 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-c76f0be4-f145-4891-b778-a3e670ba7333 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:26.602606 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-c76f0be4-f145-4891-b778-a3e670ba7333 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:26.605080 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-c76f0be4-f145-4891-b778-a3e670ba7333 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:26.606466 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-c76f0be4-f145-4891-b778-a3e670ba7333 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1726 microversion: 2.20 time: 0.196766 Aug 24 03:36:26.607120 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 340/669] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:26 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1726 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:27.631888 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-6870e696-64d2-4d22-a3a3-c2102f6afc3c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:27.632493 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-6870e696-64d2-4d22-a3a3-c2102f6afc3c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:27.640495 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6870e696-64d2-4d22-a3a3-c2102f6afc3c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:27.641135 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6870e696-64d2-4d22-a3a3-c2102f6afc3c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:27.641757 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6870e696-64d2-4d22-a3a3-c2102f6afc3c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:27.642541 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6870e696-64d2-4d22-a3a3-c2102f6afc3c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:27.643121 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6870e696-64d2-4d22-a3a3-c2102f6afc3c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:27.643579 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6870e696-64d2-4d22-a3a3-c2102f6afc3c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:27.877982 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-6870e696-64d2-4d22-a3a3-c2102f6afc3c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:27.888419 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-6870e696-64d2-4d22-a3a3-c2102f6afc3c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:27.890313 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-6870e696-64d2-4d22-a3a3-c2102f6afc3c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:27.891618 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-6870e696-64d2-4d22-a3a3-c2102f6afc3c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1726 microversion: 2.20 time: 0.264720 Aug 24 03:36:27.892787 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 330/670] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:27 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1726 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:28.917199 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-e64dd379-3f8a-4718-a90c-f303adaf32ca tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:28.917923 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-e64dd379-3f8a-4718-a90c-f303adaf32ca tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:28.924337 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e64dd379-3f8a-4718-a90c-f303adaf32ca tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:28.924852 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e64dd379-3f8a-4718-a90c-f303adaf32ca tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:28.925296 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e64dd379-3f8a-4718-a90c-f303adaf32ca tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:28.925988 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e64dd379-3f8a-4718-a90c-f303adaf32ca tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:28.926444 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e64dd379-3f8a-4718-a90c-f303adaf32ca tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:28.926875 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e64dd379-3f8a-4718-a90c-f303adaf32ca tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:29.074276 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-e64dd379-3f8a-4718-a90c-f303adaf32ca tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:29.084027 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-e64dd379-3f8a-4718-a90c-f303adaf32ca tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:29.085792 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-e64dd379-3f8a-4718-a90c-f303adaf32ca tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:29.087012 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-e64dd379-3f8a-4718-a90c-f303adaf32ca tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1747 microversion: 2.20 time: 0.175948 Aug 24 03:36:29.087581 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 341/671] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:28 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1747 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:30.111503 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-392e9cee-ba76-4420-9ca4-38f69904b35f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:30.112152 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-392e9cee-ba76-4420-9ca4-38f69904b35f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:30.118566 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-392e9cee-ba76-4420-9ca4-38f69904b35f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:30.119059 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-392e9cee-ba76-4420-9ca4-38f69904b35f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:30.119711 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-392e9cee-ba76-4420-9ca4-38f69904b35f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:30.120445 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-392e9cee-ba76-4420-9ca4-38f69904b35f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:30.120939 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-392e9cee-ba76-4420-9ca4-38f69904b35f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:30.121371 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-392e9cee-ba76-4420-9ca4-38f69904b35f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:30.247785 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-392e9cee-ba76-4420-9ca4-38f69904b35f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:30.255955 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-392e9cee-ba76-4420-9ca4-38f69904b35f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:30.257506 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-392e9cee-ba76-4420-9ca4-38f69904b35f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:30.258662 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-392e9cee-ba76-4420-9ca4-38f69904b35f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1747 microversion: 2.20 time: 0.151115 Aug 24 03:36:30.259213 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 331/672] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:30 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1747 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:31.281775 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-a1a084b1-0095-4fbb-8237-537578fb47ff tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:31.282479 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-a1a084b1-0095-4fbb-8237-537578fb47ff tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:31.288661 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a1a084b1-0095-4fbb-8237-537578fb47ff tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:31.289176 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a1a084b1-0095-4fbb-8237-537578fb47ff tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:31.289613 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a1a084b1-0095-4fbb-8237-537578fb47ff tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:31.290314 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a1a084b1-0095-4fbb-8237-537578fb47ff tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:31.290768 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a1a084b1-0095-4fbb-8237-537578fb47ff tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:31.291679 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a1a084b1-0095-4fbb-8237-537578fb47ff tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:31.445559 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-a1a084b1-0095-4fbb-8237-537578fb47ff tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:31.455386 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-a1a084b1-0095-4fbb-8237-537578fb47ff tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:31.456916 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-a1a084b1-0095-4fbb-8237-537578fb47ff tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:31.458283 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-a1a084b1-0095-4fbb-8237-537578fb47ff tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1742 microversion: 2.20 time: 0.180651 Aug 24 03:36:31.459185 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 342/673] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:31 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1742 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:32.494132 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b5d711f3-2d0a-4cf6-84c1-c18695f1a128 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:32.495000 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-b5d711f3-2d0a-4cf6-84c1-c18695f1a128 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:32.511851 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b5d711f3-2d0a-4cf6-84c1-c18695f1a128 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:32.513634 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b5d711f3-2d0a-4cf6-84c1-c18695f1a128 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:32.514283 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b5d711f3-2d0a-4cf6-84c1-c18695f1a128 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:32.520239 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b5d711f3-2d0a-4cf6-84c1-c18695f1a128 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:32.520791 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b5d711f3-2d0a-4cf6-84c1-c18695f1a128 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:32.521245 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b5d711f3-2d0a-4cf6-84c1-c18695f1a128 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:32.552425 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-8766ad5d-4b11-4513-a22b-dc3c719e27b4 req-b222e486-602d-44b5-bd81-f0c3a21fcf39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4", "name": "network-vif-plugged", "status": "completed", "tag": "c49bffe3-b213-40d0-a914-6759e188a044"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:32.592016 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-8766ad5d-4b11-4513-a22b-dc3c719e27b4 req-b222e486-602d-44b5-bd81-f0c3a21fcf39 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:32.592333 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-8766ad5d-4b11-4513-a22b-dc3c719e27b4 req-b222e486-602d-44b5-bd81-f0c3a21fcf39 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:32.596810 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-8766ad5d-4b11-4513-a22b-dc3c719e27b4 req-b222e486-602d-44b5-bd81-f0c3a21fcf39 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:32.617689 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-8766ad5d-4b11-4513-a22b-dc3c719e27b4 req-b222e486-602d-44b5-bd81-f0c3a21fcf39 service nova] Creating event network-vif-plugged:c49bffe3-b213-40d0-a914-6759e188a044 for instance a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 on hv-cinder-85426 Aug 24 03:36:32.633361 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-8766ad5d-4b11-4513-a22b-dc3c719e27b4 req-b222e486-602d-44b5-bd81-f0c3a21fcf39 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084367 Aug 24 03:36:32.638005 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 343/674] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:36:33.519558 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-b5d711f3-2d0a-4cf6-84c1-c18695f1a128 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:33.529471 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-b5d711f3-2d0a-4cf6-84c1-c18695f1a128 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:33.537102 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-b5d711f3-2d0a-4cf6-84c1-c18695f1a128 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:33.538306 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-b5d711f3-2d0a-4cf6-84c1-c18695f1a128 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1742 microversion: 2.20 time: 1.055454 Aug 24 03:36:33.538841 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 332/675] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:32 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1742 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:34.569183 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-e55a4914-c6b5-41ed-b13c-40c66c9d40a0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:34.572487 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-e55a4914-c6b5-41ed-b13c-40c66c9d40a0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:34.580940 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e55a4914-c6b5-41ed-b13c-40c66c9d40a0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:34.584987 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e55a4914-c6b5-41ed-b13c-40c66c9d40a0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:34.584987 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e55a4914-c6b5-41ed-b13c-40c66c9d40a0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:34.584987 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e55a4914-c6b5-41ed-b13c-40c66c9d40a0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:34.584987 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e55a4914-c6b5-41ed-b13c-40c66c9d40a0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:34.585377 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e55a4914-c6b5-41ed-b13c-40c66c9d40a0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:34.819539 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-e55a4914-c6b5-41ed-b13c-40c66c9d40a0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:34.830585 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-e55a4914-c6b5-41ed-b13c-40c66c9d40a0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:34.841944 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-e55a4914-c6b5-41ed-b13c-40c66c9d40a0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:34.844438 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-e55a4914-c6b5-41ed-b13c-40c66c9d40a0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1742 microversion: 2.20 time: 0.280543 Aug 24 03:36:34.845570 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 344/676] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:34 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1742 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:35.867609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-025aa04a-f922-4ebb-a31d-bc7a936ae322 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:35.868472 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-025aa04a-f922-4ebb-a31d-bc7a936ae322 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:35.884107 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-025aa04a-f922-4ebb-a31d-bc7a936ae322 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:35.884606 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-025aa04a-f922-4ebb-a31d-bc7a936ae322 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:35.885606 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-025aa04a-f922-4ebb-a31d-bc7a936ae322 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:35.886323 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-025aa04a-f922-4ebb-a31d-bc7a936ae322 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:35.886786 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-025aa04a-f922-4ebb-a31d-bc7a936ae322 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:35.887215 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-025aa04a-f922-4ebb-a31d-bc7a936ae322 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:36.076135 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-025aa04a-f922-4ebb-a31d-bc7a936ae322 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:36.088746 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-025aa04a-f922-4ebb-a31d-bc7a936ae322 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:36.091787 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-025aa04a-f922-4ebb-a31d-bc7a936ae322 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:36.093634 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-025aa04a-f922-4ebb-a31d-bc7a936ae322 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1742 microversion: 2.20 time: 0.229719 Aug 24 03:36:36.095041 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 333/677] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:35 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1742 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:37.121312 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-1d9105f4-8464-4b21-a2b3-02969f5742a3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:37.121975 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-1d9105f4-8464-4b21-a2b3-02969f5742a3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:37.128178 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1d9105f4-8464-4b21-a2b3-02969f5742a3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:37.128671 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1d9105f4-8464-4b21-a2b3-02969f5742a3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:37.129158 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1d9105f4-8464-4b21-a2b3-02969f5742a3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:37.129861 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1d9105f4-8464-4b21-a2b3-02969f5742a3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:37.130317 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1d9105f4-8464-4b21-a2b3-02969f5742a3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:37.130739 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1d9105f4-8464-4b21-a2b3-02969f5742a3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:37.320222 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-1d9105f4-8464-4b21-a2b3-02969f5742a3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:37.332492 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-1d9105f4-8464-4b21-a2b3-02969f5742a3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:37.334880 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-1d9105f4-8464-4b21-a2b3-02969f5742a3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:37.336634 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-1d9105f4-8464-4b21-a2b3-02969f5742a3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1742 microversion: 2.20 time: 0.219049 Aug 24 03:36:37.348796 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 345/678] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:37 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1742 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:38.362341 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4310d80a-61a0-40dc-9134-5dca7cadd7f4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:38.363941 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-4310d80a-61a0-40dc-9134-5dca7cadd7f4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:38.374501 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4310d80a-61a0-40dc-9134-5dca7cadd7f4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:38.377864 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4310d80a-61a0-40dc-9134-5dca7cadd7f4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:38.378358 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4310d80a-61a0-40dc-9134-5dca7cadd7f4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:38.380255 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4310d80a-61a0-40dc-9134-5dca7cadd7f4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:38.380735 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4310d80a-61a0-40dc-9134-5dca7cadd7f4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:38.381192 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4310d80a-61a0-40dc-9134-5dca7cadd7f4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:38.605480 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4310d80a-61a0-40dc-9134-5dca7cadd7f4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:38.621936 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4310d80a-61a0-40dc-9134-5dca7cadd7f4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:38.623542 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4310d80a-61a0-40dc-9134-5dca7cadd7f4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:38.624752 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4310d80a-61a0-40dc-9134-5dca7cadd7f4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1742 microversion: 2.20 time: 0.266572 Aug 24 03:36:38.626413 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 334/679] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:38 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1742 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:39.647698 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-39c22c9e-32f2-4388-bdd8-0fa4805af695 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:39.648280 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-39c22c9e-32f2-4388-bdd8-0fa4805af695 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:39.657823 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-39c22c9e-32f2-4388-bdd8-0fa4805af695 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:39.659196 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-39c22c9e-32f2-4388-bdd8-0fa4805af695 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:39.659800 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-39c22c9e-32f2-4388-bdd8-0fa4805af695 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:39.660883 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-39c22c9e-32f2-4388-bdd8-0fa4805af695 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:39.661556 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-39c22c9e-32f2-4388-bdd8-0fa4805af695 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:39.662219 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-39c22c9e-32f2-4388-bdd8-0fa4805af695 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:39.845994 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-39c22c9e-32f2-4388-bdd8-0fa4805af695 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:39.855780 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-39c22c9e-32f2-4388-bdd8-0fa4805af695 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:39.857321 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-39c22c9e-32f2-4388-bdd8-0fa4805af695 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:39.858478 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-39c22c9e-32f2-4388-bdd8-0fa4805af695 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1742 microversion: 2.20 time: 0.214981 Aug 24 03:36:39.859037 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 346/680] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:39 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1742 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:40.886724 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-3e066a29-c8a5-486d-ac36-d900735d3614 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:40.887942 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-3e066a29-c8a5-486d-ac36-d900735d3614 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:40.901418 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3e066a29-c8a5-486d-ac36-d900735d3614 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:40.902194 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3e066a29-c8a5-486d-ac36-d900735d3614 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:40.902857 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3e066a29-c8a5-486d-ac36-d900735d3614 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:40.903804 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3e066a29-c8a5-486d-ac36-d900735d3614 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:40.905168 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3e066a29-c8a5-486d-ac36-d900735d3614 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:40.905968 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3e066a29-c8a5-486d-ac36-d900735d3614 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:41.139842 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-3e066a29-c8a5-486d-ac36-d900735d3614 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:41.150947 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-3e066a29-c8a5-486d-ac36-d900735d3614 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:41.153425 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-3e066a29-c8a5-486d-ac36-d900735d3614 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:41.154783 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-3e066a29-c8a5-486d-ac36-d900735d3614 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1742 microversion: 2.20 time: 0.272477 Aug 24 03:36:41.155726 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 335/681] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:40 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1742 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:36:42.193400 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-885582f9-cf58-4c89-a725-ad0263282fa4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:42.194145 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-885582f9-cf58-4c89-a725-ad0263282fa4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:42.198289 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-9143c622-ebcc-46e9-bf26-fcab98bbdd5d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1132579922", "imageRef": "b7a40f0c-20c2-44cd-8b0e-f6e73a007d3e", "flavorRef": "452"}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:42.203961 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-885582f9-cf58-4c89-a725-ad0263282fa4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:42.203961 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-885582f9-cf58-4c89-a725-ad0263282fa4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:42.204245 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-885582f9-cf58-4c89-a725-ad0263282fa4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:42.205265 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-885582f9-cf58-4c89-a725-ad0263282fa4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:42.205729 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-885582f9-cf58-4c89-a725-ad0263282fa4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:42.206106 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-885582f9-cf58-4c89-a725-ad0263282fa4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:42.261639 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.network.neutron [None req-9143c622-ebcc-46e9-bf26-fcab98bbdd5d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] validate_networks() for None {{(pid=120708) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:36:42.504317 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-885582f9-cf58-4c89-a725-ad0263282fa4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:42.507520 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:42.516869 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-885582f9-cf58-4c89-a725-ad0263282fa4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:42.518497 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-885582f9-cf58-4c89-a725-ad0263282fa4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:42.519717 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-885582f9-cf58-4c89-a725-ad0263282fa4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1742 microversion: 2.20 time: 0.330510 Aug 24 03:36:42.520296 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 347/682] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:42 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1742 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:42.630976 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-9143c622-ebcc-46e9-bf26-fcab98bbdd5d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Flavor limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:36:42.631555 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-9143c622-ebcc-46e9-bf26-fcab98bbdd5d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Image limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:36:42.632054 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-9143c622-ebcc-46e9-bf26-fcab98bbdd5d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Flavor pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:36:42.632542 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-9143c622-ebcc-46e9-bf26-fcab98bbdd5d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Image pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:36:42.633035 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-9143c622-ebcc-46e9-bf26-fcab98bbdd5d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:36:42.643414 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9143c622-ebcc-46e9-bf26-fcab98bbdd5d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:42.643891 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9143c622-ebcc-46e9-bf26-fcab98bbdd5d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:42.644328 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9143c622-ebcc-46e9-bf26-fcab98bbdd5d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:42.645086 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9143c622-ebcc-46e9-bf26-fcab98bbdd5d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:42.645531 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9143c622-ebcc-46e9-bf26-fcab98bbdd5d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:42.645951 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9143c622-ebcc-46e9-bf26-fcab98bbdd5d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:42.663193 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-9143c622-ebcc-46e9-bf26-fcab98bbdd5d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Getting quotas for project d5e2d5c2e0ce43f9b352daee2f2bf5f9. Resources: {'ram', 'instances', 'cores'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:36:42.668078 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-9143c622-ebcc-46e9-bf26-fcab98bbdd5d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Getting quotas for user 467f45f0cfdb4ef58f893e633075e3ae and project d5e2d5c2e0ce43f9b352daee2f2bf5f9. Resources: {'ram', 'instances', 'cores'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:36:42.679414 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-9143c622-ebcc-46e9-bf26-fcab98bbdd5d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Going to run 1 instances... {{(pid=120708) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:36:42.681778 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-9143c622-ebcc-46e9-bf26-fcab98bbdd5d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] [instance: 287e45cb-e736-49a5-9d00-1d603163b29a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b7a40f0c-20c2-44cd-8b0e-f6e73a007d3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120708) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:36:42.728482 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-9143c622-ebcc-46e9-bf26-fcab98bbdd5d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.535442 Aug 24 03:36:42.729132 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 336/683] 10.222.0.81 () {60 vars in 1147 bytes} [Wed Aug 24 03:36:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:36:42.739869 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-194745dc-8677-41a5-a4c6-8baf45cc6be2 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:42.740586 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-194745dc-8677-41a5-a4c6-8baf45cc6be2 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] [instance: 287e45cb-e736-49a5-9d00-1d603163b29a] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:42.802883 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-194745dc-8677-41a5-a4c6-8baf45cc6be2 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467f45f0cfdb4ef58f893e633075e3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e2d5c2e0ce43f9b352daee2f2bf5f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:42.811672 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-194745dc-8677-41a5-a4c6-8baf45cc6be2 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] 10.222.0.81 "GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a" status: 200 len: 1215 microversion: 2.1 time: 0.075642 Aug 24 03:36:42.812541 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 348/684] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:42 2022] GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a => generated 1215 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:43.543359 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-bb426937-cafa-4146-b52b-2a242fdfee0b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:43.544514 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-bb426937-cafa-4146-b52b-2a242fdfee0b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:43.551516 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bb426937-cafa-4146-b52b-2a242fdfee0b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:43.551994 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bb426937-cafa-4146-b52b-2a242fdfee0b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:43.552423 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bb426937-cafa-4146-b52b-2a242fdfee0b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:43.553135 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bb426937-cafa-4146-b52b-2a242fdfee0b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:43.553583 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bb426937-cafa-4146-b52b-2a242fdfee0b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:43.554001 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bb426937-cafa-4146-b52b-2a242fdfee0b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:43.684576 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-bb426937-cafa-4146-b52b-2a242fdfee0b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:43.693007 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-bb426937-cafa-4146-b52b-2a242fdfee0b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:43.694602 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-bb426937-cafa-4146-b52b-2a242fdfee0b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:43.695776 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-bb426937-cafa-4146-b52b-2a242fdfee0b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1724 microversion: 2.20 time: 0.156642 Aug 24 03:36:43.696333 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 337/685] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:43 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:43.833701 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-2d600461-b5f0-4610-99d1-357e2ddf32ae tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:43.834832 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-2d600461-b5f0-4610-99d1-357e2ddf32ae tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] [instance: 287e45cb-e736-49a5-9d00-1d603163b29a] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:43.838667 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_api:SELECT=38 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:43.845342 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2d600461-b5f0-4610-99d1-357e2ddf32ae tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:43.845840 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2d600461-b5f0-4610-99d1-357e2ddf32ae tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:43.846278 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2d600461-b5f0-4610-99d1-357e2ddf32ae tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:43.846978 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2d600461-b5f0-4610-99d1-357e2ddf32ae tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:43.847438 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2d600461-b5f0-4610-99d1-357e2ddf32ae tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:43.847861 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2d600461-b5f0-4610-99d1-357e2ddf32ae tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:43.914202 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-2d600461-b5f0-4610-99d1-357e2ddf32ae tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467f45f0cfdb4ef58f893e633075e3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e2d5c2e0ce43f9b352daee2f2bf5f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:43.922471 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-2d600461-b5f0-4610-99d1-357e2ddf32ae tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] 10.222.0.81 "GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a" status: 200 len: 1285 microversion: 2.1 time: 0.092862 Aug 24 03:36:43.923267 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 349/686] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:43 2022] GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a => generated 1285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:44.719466 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ba148a2a-7c57-4bb6-a24f-97f31ebe9aa3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:44.720071 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ba148a2a-7c57-4bb6-a24f-97f31ebe9aa3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:44.726568 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ba148a2a-7c57-4bb6-a24f-97f31ebe9aa3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:44.727052 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ba148a2a-7c57-4bb6-a24f-97f31ebe9aa3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:44.727586 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ba148a2a-7c57-4bb6-a24f-97f31ebe9aa3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:44.728277 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ba148a2a-7c57-4bb6-a24f-97f31ebe9aa3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:44.729812 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ba148a2a-7c57-4bb6-a24f-97f31ebe9aa3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:44.729812 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ba148a2a-7c57-4bb6-a24f-97f31ebe9aa3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:44.927626 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ba148a2a-7c57-4bb6-a24f-97f31ebe9aa3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:44.937665 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ba148a2a-7c57-4bb6-a24f-97f31ebe9aa3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:44.939179 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ba148a2a-7c57-4bb6-a24f-97f31ebe9aa3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:44.940429 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ba148a2a-7c57-4bb6-a24f-97f31ebe9aa3 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1724 microversion: 2.20 time: 0.225107 Aug 24 03:36:44.941015 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 338/687] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:44 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:44.945765 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-5f4d0b95-dc57-4b48-be46-64102037a718 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:44.946390 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-5f4d0b95-dc57-4b48-be46-64102037a718 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] [instance: 287e45cb-e736-49a5-9d00-1d603163b29a] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:44.952850 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5f4d0b95-dc57-4b48-be46-64102037a718 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:44.953522 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5f4d0b95-dc57-4b48-be46-64102037a718 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:44.954134 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5f4d0b95-dc57-4b48-be46-64102037a718 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:44.954840 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5f4d0b95-dc57-4b48-be46-64102037a718 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:44.955310 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5f4d0b95-dc57-4b48-be46-64102037a718 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:44.955738 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5f4d0b95-dc57-4b48-be46-64102037a718 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:45.019376 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-5f4d0b95-dc57-4b48-be46-64102037a718 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467f45f0cfdb4ef58f893e633075e3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e2d5c2e0ce43f9b352daee2f2bf5f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:45.027892 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-5f4d0b95-dc57-4b48-be46-64102037a718 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] 10.222.0.81 "GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a" status: 200 len: 1285 microversion: 2.1 time: 0.086724 Aug 24 03:36:45.028463 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 350/688] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:44 2022] GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a => generated 1285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:45.965851 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-8c08c085-909a-4bbb-816e-9f3a8533d008 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:45.967395 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-8c08c085-909a-4bbb-816e-9f3a8533d008 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:45.974402 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8c08c085-909a-4bbb-816e-9f3a8533d008 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:45.975066 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8c08c085-909a-4bbb-816e-9f3a8533d008 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:45.975661 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8c08c085-909a-4bbb-816e-9f3a8533d008 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:45.976611 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8c08c085-909a-4bbb-816e-9f3a8533d008 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:45.977240 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8c08c085-909a-4bbb-816e-9f3a8533d008 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:45.977825 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8c08c085-909a-4bbb-816e-9f3a8533d008 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:46.051352 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-5dba0c4c-0874-4723-a9c8-aaa36b487262 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:46.052717 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-5dba0c4c-0874-4723-a9c8-aaa36b487262 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] [instance: 287e45cb-e736-49a5-9d00-1d603163b29a] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:46.060346 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5dba0c4c-0874-4723-a9c8-aaa36b487262 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:46.061157 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5dba0c4c-0874-4723-a9c8-aaa36b487262 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:46.061753 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5dba0c4c-0874-4723-a9c8-aaa36b487262 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:46.062616 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5dba0c4c-0874-4723-a9c8-aaa36b487262 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:46.063215 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5dba0c4c-0874-4723-a9c8-aaa36b487262 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:46.063796 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5dba0c4c-0874-4723-a9c8-aaa36b487262 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:46.148367 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-5dba0c4c-0874-4723-a9c8-aaa36b487262 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467f45f0cfdb4ef58f893e633075e3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e2d5c2e0ce43f9b352daee2f2bf5f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:46.163499 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-5dba0c4c-0874-4723-a9c8-aaa36b487262 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] 10.222.0.81 "GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a" status: 200 len: 1273 microversion: 2.1 time: 0.115892 Aug 24 03:36:46.164569 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 351/689] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:46 2022] GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a => generated 1273 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:46.181188 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-8c08c085-909a-4bbb-816e-9f3a8533d008 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:46.192986 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-8c08c085-909a-4bbb-816e-9f3a8533d008 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:46.195558 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-8c08c085-909a-4bbb-816e-9f3a8533d008 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:46.197217 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-8c08c085-909a-4bbb-816e-9f3a8533d008 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1667 microversion: 2.20 time: 0.237013 Aug 24 03:36:46.198107 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 339/690] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:45 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1667 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:46.220291 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-40fbbe82-d3a8-4b47-b098-3cebab7878e7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b9b1a3e-a99a-48a1-8447-c8d8b4674f25"}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:46.223139 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-40fbbe82-d3a8-4b47-b098-3cebab7878e7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:46.230071 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-40fbbe82-d3a8-4b47-b098-3cebab7878e7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:46.230559 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-40fbbe82-d3a8-4b47-b098-3cebab7878e7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:46.231163 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-40fbbe82-d3a8-4b47-b098-3cebab7878e7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:46.232116 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-40fbbe82-d3a8-4b47-b098-3cebab7878e7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:46.232735 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-40fbbe82-d3a8-4b47-b098-3cebab7878e7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:46.233545 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-40fbbe82-d3a8-4b47-b098-3cebab7878e7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:46.546052 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-8f086c02-fff6-4e0d-ae54-be975211ff05 req-cb303f12-e08e-49e8-ae90-07bea8584da8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4", "name": "network-vif-unplugged", "status": "completed", "tag": "c49bffe3-b213-40d0-a914-6759e188a044"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:46.559212 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-8f086c02-fff6-4e0d-ae54-be975211ff05 req-cb303f12-e08e-49e8-ae90-07bea8584da8 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:46.560022 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-8f086c02-fff6-4e0d-ae54-be975211ff05 req-cb303f12-e08e-49e8-ae90-07bea8584da8 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:46.560599 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-8f086c02-fff6-4e0d-ae54-be975211ff05 req-cb303f12-e08e-49e8-ae90-07bea8584da8 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:46.575735 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.compute.server_external_events [req-8f086c02-fff6-4e0d-ae54-be975211ff05 req-cb303f12-e08e-49e8-ae90-07bea8584da8 service nova] Unable to find a host for instance a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4. Dropping event network-vif-unplugged {{(pid=120708) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 03:36:46.576966 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-8f086c02-fff6-4e0d-ae54-be975211ff05 req-cb303f12-e08e-49e8-ae90-07bea8584da8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036475 Aug 24 03:36:46.577747 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 340/691] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 24 03:36:46.608488 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-40fbbe82-d3a8-4b47-b098-3cebab7878e7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "POST /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.392463 Aug 24 03:36:46.614521 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 352/692] 10.222.0.81 () {62 vars in 1364 bytes} [Wed Aug 24 03:36:46 2022] POST /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4/os-volume_attachments => generated 188 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:36:46.757090 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d7006788-c804-4143-9765-064fef0f03b2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:46.757590 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d7006788-c804-4143-9765-064fef0f03b2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:46.764674 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d7006788-c804-4143-9765-064fef0f03b2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:46.765194 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d7006788-c804-4143-9765-064fef0f03b2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:46.765623 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d7006788-c804-4143-9765-064fef0f03b2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:46.766329 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d7006788-c804-4143-9765-064fef0f03b2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:46.766841 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d7006788-c804-4143-9765-064fef0f03b2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:46.767167 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d7006788-c804-4143-9765-064fef0f03b2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:47.069880 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:47.085994 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d7006788-c804-4143-9765-064fef0f03b2 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4/os-volume_attachments/5b9b1a3e-a99a-48a1-8447-c8d8b4674f25" status: 202 len: 0 microversion: 2.20 time: 0.332962 Aug 24 03:36:47.087517 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 341/693] 10.222.0.81 () {60 vars in 1457 bytes} [Wed Aug 24 03:36:46 2022] DELETE /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4/os-volume_attachments/5b9b1a3e-a99a-48a1-8447-c8d8b4674f25 => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:36:47.161339 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-4ff4b79e-49fb-4dae-85e8-db2dd2895738 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:47.161886 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-4ff4b79e-49fb-4dae-85e8-db2dd2895738 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:47.170008 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4ff4b79e-49fb-4dae-85e8-db2dd2895738 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:47.170497 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4ff4b79e-49fb-4dae-85e8-db2dd2895738 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:47.170930 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4ff4b79e-49fb-4dae-85e8-db2dd2895738 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:47.171623 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4ff4b79e-49fb-4dae-85e8-db2dd2895738 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:47.172069 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4ff4b79e-49fb-4dae-85e8-db2dd2895738 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:47.172691 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4ff4b79e-49fb-4dae-85e8-db2dd2895738 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:47.188495 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-bdd9150d-3136-43ba-9628-98aa9c4129e9 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:47.189817 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-bdd9150d-3136-43ba-9628-98aa9c4129e9 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] [instance: 287e45cb-e736-49a5-9d00-1d603163b29a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:47.196127 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bdd9150d-3136-43ba-9628-98aa9c4129e9 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:47.198292 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bdd9150d-3136-43ba-9628-98aa9c4129e9 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:47.198837 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bdd9150d-3136-43ba-9628-98aa9c4129e9 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:47.201122 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bdd9150d-3136-43ba-9628-98aa9c4129e9 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:47.201965 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bdd9150d-3136-43ba-9628-98aa9c4129e9 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:47.202547 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bdd9150d-3136-43ba-9628-98aa9c4129e9 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:47.382960 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-4ff4b79e-49fb-4dae-85e8-db2dd2895738 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120709) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 03:36:47.455358 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-bdd9150d-3136-43ba-9628-98aa9c4129e9 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467f45f0cfdb4ef58f893e633075e3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e2d5c2e0ce43f9b352daee2f2bf5f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:47.483810 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-bdd9150d-3136-43ba-9628-98aa9c4129e9 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] 10.222.0.81 "GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a" status: 200 len: 1315 microversion: 2.1 time: 0.299014 Aug 24 03:36:47.486618 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 342/694] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:47 2022] GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:47.486926 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-4ff4b79e-49fb-4dae-85e8-db2dd2895738 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "POST /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4/action" status: 202 len: 0 microversion: 2.20 time: 0.329126 Aug 24 03:36:47.488163 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 353/695] 10.222.0.81 () {62 vars in 1319 bytes} [Wed Aug 24 03:36:47 2022] POST /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:36:47.510327 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-93289439-4b71-48ff-a9ed-41c027ade0eb tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:47.511808 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-93289439-4b71-48ff-a9ed-41c027ade0eb tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:47.529278 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-9cb74c9d-21bc-4b67-ad28-e440b8007a90 req-c29313eb-bfa3-401c-8050-efda94798db1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "287e45cb-e736-49a5-9d00-1d603163b29a", "tag": "8c0cf45f-a6e0-4319-bf26-59451ac30413"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:47.549099 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-93289439-4b71-48ff-a9ed-41c027ade0eb tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:47.550217 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-9cb74c9d-21bc-4b67-ad28-e440b8007a90 req-c29313eb-bfa3-401c-8050-efda94798db1 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:47.550849 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-93289439-4b71-48ff-a9ed-41c027ade0eb tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:47.551041 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-9cb74c9d-21bc-4b67-ad28-e440b8007a90 req-c29313eb-bfa3-401c-8050-efda94798db1 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:47.551708 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-9cb74c9d-21bc-4b67-ad28-e440b8007a90 req-c29313eb-bfa3-401c-8050-efda94798db1 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:47.552278 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-93289439-4b71-48ff-a9ed-41c027ade0eb tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:47.554651 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-93289439-4b71-48ff-a9ed-41c027ade0eb tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:47.555888 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-93289439-4b71-48ff-a9ed-41c027ade0eb tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:47.557448 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-93289439-4b71-48ff-a9ed-41c027ade0eb tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:47.566965 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-9cb74c9d-21bc-4b67-ad28-e440b8007a90 req-c29313eb-bfa3-401c-8050-efda94798db1 service nova] Creating event network-changed:8c0cf45f-a6e0-4319-bf26-59451ac30413 for instance 287e45cb-e736-49a5-9d00-1d603163b29a on hv-cinder-85426 Aug 24 03:36:47.573921 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-9cb74c9d-21bc-4b67-ad28-e440b8007a90 req-c29313eb-bfa3-401c-8050-efda94798db1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055894 Aug 24 03:36:47.574930 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 354/696] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:36:47.719720 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-93289439-4b71-48ff-a9ed-41c027ade0eb tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:47.730416 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-93289439-4b71-48ff-a9ed-41c027ade0eb tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:47.738729 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-93289439-4b71-48ff-a9ed-41c027ade0eb tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:47.742466 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-93289439-4b71-48ff-a9ed-41c027ade0eb tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1675 microversion: 2.20 time: 0.245213 Aug 24 03:36:47.743341 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 343/697] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:47 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1675 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:48.510228 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-812117cc-b8be-4fda-91d9-c3830aa29d5e tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:48.511191 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-812117cc-b8be-4fda-91d9-c3830aa29d5e tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] [instance: 287e45cb-e736-49a5-9d00-1d603163b29a] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:48.517829 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-812117cc-b8be-4fda-91d9-c3830aa29d5e tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:48.518335 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-812117cc-b8be-4fda-91d9-c3830aa29d5e tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:48.518781 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-812117cc-b8be-4fda-91d9-c3830aa29d5e tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:48.519487 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-812117cc-b8be-4fda-91d9-c3830aa29d5e tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:48.519944 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-812117cc-b8be-4fda-91d9-c3830aa29d5e tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:48.520372 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-812117cc-b8be-4fda-91d9-c3830aa29d5e tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:48.652262 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-812117cc-b8be-4fda-91d9-c3830aa29d5e tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467f45f0cfdb4ef58f893e633075e3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e2d5c2e0ce43f9b352daee2f2bf5f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:48.661505 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-812117cc-b8be-4fda-91d9-c3830aa29d5e tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] 10.222.0.81 "GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a" status: 200 len: 1315 microversion: 2.1 time: 0.156399 Aug 24 03:36:48.662271 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 355/698] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:48 2022] GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:48.768934 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ad13a4ea-69a8-4d7e-b50c-9a0a0873b8ff tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:48.768934 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ad13a4ea-69a8-4d7e-b50c-9a0a0873b8ff tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:48.774923 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ad13a4ea-69a8-4d7e-b50c-9a0a0873b8ff tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:48.776073 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ad13a4ea-69a8-4d7e-b50c-9a0a0873b8ff tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:48.776632 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ad13a4ea-69a8-4d7e-b50c-9a0a0873b8ff tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:48.777376 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ad13a4ea-69a8-4d7e-b50c-9a0a0873b8ff tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:48.777830 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ad13a4ea-69a8-4d7e-b50c-9a0a0873b8ff tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:48.778260 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ad13a4ea-69a8-4d7e-b50c-9a0a0873b8ff tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:48.929774 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ad13a4ea-69a8-4d7e-b50c-9a0a0873b8ff tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:48.939126 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ad13a4ea-69a8-4d7e-b50c-9a0a0873b8ff tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:48.940645 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ad13a4ea-69a8-4d7e-b50c-9a0a0873b8ff tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:48.941847 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ad13a4ea-69a8-4d7e-b50c-9a0a0873b8ff tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1675 microversion: 2.20 time: 0.178714 Aug 24 03:36:48.942965 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 344/699] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:48 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1675 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:49.683459 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-cc877e69-0d42-4b26-bce5-7f1682386825 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:49.684070 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-cc877e69-0d42-4b26-bce5-7f1682386825 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] [instance: 287e45cb-e736-49a5-9d00-1d603163b29a] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:49.690728 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cc877e69-0d42-4b26-bce5-7f1682386825 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:49.691206 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cc877e69-0d42-4b26-bce5-7f1682386825 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:49.691636 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cc877e69-0d42-4b26-bce5-7f1682386825 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:49.692317 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cc877e69-0d42-4b26-bce5-7f1682386825 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:49.692784 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cc877e69-0d42-4b26-bce5-7f1682386825 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:49.693204 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cc877e69-0d42-4b26-bce5-7f1682386825 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:49.830747 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-cc877e69-0d42-4b26-bce5-7f1682386825 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467f45f0cfdb4ef58f893e633075e3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e2d5c2e0ce43f9b352daee2f2bf5f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:49.839637 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-cc877e69-0d42-4b26-bce5-7f1682386825 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] 10.222.0.81 "GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a" status: 200 len: 1315 microversion: 2.1 time: 0.160555 Aug 24 03:36:49.840302 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 356/700] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:49 2022] GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:49.965432 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f2a2181c-4ff5-4e6c-a8f5-86b7e8632f13 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:49.965972 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f2a2181c-4ff5-4e6c-a8f5-86b7e8632f13 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:49.972885 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f2a2181c-4ff5-4e6c-a8f5-86b7e8632f13 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:49.973363 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f2a2181c-4ff5-4e6c-a8f5-86b7e8632f13 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:49.973799 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f2a2181c-4ff5-4e6c-a8f5-86b7e8632f13 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:49.974559 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f2a2181c-4ff5-4e6c-a8f5-86b7e8632f13 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:49.975013 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f2a2181c-4ff5-4e6c-a8f5-86b7e8632f13 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:49.975437 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f2a2181c-4ff5-4e6c-a8f5-86b7e8632f13 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:50.104971 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f2a2181c-4ff5-4e6c-a8f5-86b7e8632f13 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:50.113133 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f2a2181c-4ff5-4e6c-a8f5-86b7e8632f13 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:50.114644 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f2a2181c-4ff5-4e6c-a8f5-86b7e8632f13 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:50.115800 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f2a2181c-4ff5-4e6c-a8f5-86b7e8632f13 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1677 microversion: 2.20 time: 0.155152 Aug 24 03:36:50.116364 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 345/701] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:49 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:50.861651 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-3192a2df-dc0b-4240-971d-08b73264929a tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:50.862271 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-3192a2df-dc0b-4240-971d-08b73264929a tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] [instance: 287e45cb-e736-49a5-9d00-1d603163b29a] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:50.868609 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3192a2df-dc0b-4240-971d-08b73264929a tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:50.869935 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3192a2df-dc0b-4240-971d-08b73264929a tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:50.870529 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3192a2df-dc0b-4240-971d-08b73264929a tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:50.871206 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3192a2df-dc0b-4240-971d-08b73264929a tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:50.871706 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3192a2df-dc0b-4240-971d-08b73264929a tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:50.872141 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3192a2df-dc0b-4240-971d-08b73264929a tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:51.003870 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-3192a2df-dc0b-4240-971d-08b73264929a tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467f45f0cfdb4ef58f893e633075e3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e2d5c2e0ce43f9b352daee2f2bf5f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:51.011746 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-3192a2df-dc0b-4240-971d-08b73264929a tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] 10.222.0.81 "GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a" status: 200 len: 1315 microversion: 2.1 time: 0.153871 Aug 24 03:36:51.012440 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 357/702] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:50 2022] GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:51.138926 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c1431128-c5ea-4afb-b339-01af8c641421 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:51.139538 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c1431128-c5ea-4afb-b339-01af8c641421 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:51.141917 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:51.147661 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c1431128-c5ea-4afb-b339-01af8c641421 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:51.148147 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c1431128-c5ea-4afb-b339-01af8c641421 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:51.148587 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c1431128-c5ea-4afb-b339-01af8c641421 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:51.149303 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c1431128-c5ea-4afb-b339-01af8c641421 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:51.149760 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c1431128-c5ea-4afb-b339-01af8c641421 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:51.150724 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c1431128-c5ea-4afb-b339-01af8c641421 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:51.278671 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c1431128-c5ea-4afb-b339-01af8c641421 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:51.286729 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c1431128-c5ea-4afb-b339-01af8c641421 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:51.288249 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c1431128-c5ea-4afb-b339-01af8c641421 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:51.289435 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c1431128-c5ea-4afb-b339-01af8c641421 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1677 microversion: 2.20 time: 0.154462 Aug 24 03:36:51.289994 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 346/703] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:51 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:52.034734 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-d64e2f00-c86d-4f82-b649-2aad802c50cf tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:52.035514 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-d64e2f00-c86d-4f82-b649-2aad802c50cf tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] [instance: 287e45cb-e736-49a5-9d00-1d603163b29a] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:52.042063 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d64e2f00-c86d-4f82-b649-2aad802c50cf tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:52.042488 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d64e2f00-c86d-4f82-b649-2aad802c50cf tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:52.042927 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d64e2f00-c86d-4f82-b649-2aad802c50cf tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:52.043623 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d64e2f00-c86d-4f82-b649-2aad802c50cf tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:52.044072 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d64e2f00-c86d-4f82-b649-2aad802c50cf tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:52.044553 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d64e2f00-c86d-4f82-b649-2aad802c50cf tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:52.197843 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-d64e2f00-c86d-4f82-b649-2aad802c50cf tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467f45f0cfdb4ef58f893e633075e3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e2d5c2e0ce43f9b352daee2f2bf5f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:52.207566 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-d64e2f00-c86d-4f82-b649-2aad802c50cf tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] 10.222.0.81 "GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a" status: 200 len: 1315 microversion: 2.1 time: 0.176559 Aug 24 03:36:52.208288 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 358/704] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:52 2022] GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:52.312482 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-3bf3e25b-01c0-453b-967b-ee65fba5372a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:52.313049 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-3bf3e25b-01c0-453b-967b-ee65fba5372a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:52.319394 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3bf3e25b-01c0-453b-967b-ee65fba5372a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:52.319883 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3bf3e25b-01c0-453b-967b-ee65fba5372a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:52.320319 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3bf3e25b-01c0-453b-967b-ee65fba5372a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:52.321045 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3bf3e25b-01c0-453b-967b-ee65fba5372a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:52.321506 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3bf3e25b-01c0-453b-967b-ee65fba5372a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:52.321934 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3bf3e25b-01c0-453b-967b-ee65fba5372a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:52.451127 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-3bf3e25b-01c0-453b-967b-ee65fba5372a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:52.459152 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-3bf3e25b-01c0-453b-967b-ee65fba5372a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:52.460638 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-3bf3e25b-01c0-453b-967b-ee65fba5372a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:52.461807 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-3bf3e25b-01c0-453b-967b-ee65fba5372a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1733 microversion: 2.20 time: 0.153292 Aug 24 03:36:52.462355 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 347/705] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:52 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:53.231937 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-6ddaf50c-aa60-49c7-a7e9-317b3ef85102 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:53.233174 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-6ddaf50c-aa60-49c7-a7e9-317b3ef85102 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] [instance: 287e45cb-e736-49a5-9d00-1d603163b29a] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:53.235876 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell0:SELECT=2 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:53.242521 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6ddaf50c-aa60-49c7-a7e9-317b3ef85102 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:53.243590 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6ddaf50c-aa60-49c7-a7e9-317b3ef85102 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:53.244504 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6ddaf50c-aa60-49c7-a7e9-317b3ef85102 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:53.245570 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6ddaf50c-aa60-49c7-a7e9-317b3ef85102 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:53.246295 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6ddaf50c-aa60-49c7-a7e9-317b3ef85102 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:53.247111 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6ddaf50c-aa60-49c7-a7e9-317b3ef85102 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:53.403912 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-6ddaf50c-aa60-49c7-a7e9-317b3ef85102 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467f45f0cfdb4ef58f893e633075e3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e2d5c2e0ce43f9b352daee2f2bf5f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:53.413474 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-6ddaf50c-aa60-49c7-a7e9-317b3ef85102 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] 10.222.0.81 "GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a" status: 200 len: 1315 microversion: 2.1 time: 0.187510 Aug 24 03:36:53.429422 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 359/706] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:53 2022] GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:53.486818 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d2e25633-cef2-4536-8943-240696a6bfe6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:53.488088 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d2e25633-cef2-4536-8943-240696a6bfe6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:53.490327 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=2 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:53.491072 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=6 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:53.498681 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d2e25633-cef2-4536-8943-240696a6bfe6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:53.499432 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d2e25633-cef2-4536-8943-240696a6bfe6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:53.500613 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d2e25633-cef2-4536-8943-240696a6bfe6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:53.501766 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d2e25633-cef2-4536-8943-240696a6bfe6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:53.502433 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d2e25633-cef2-4536-8943-240696a6bfe6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:53.503086 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d2e25633-cef2-4536-8943-240696a6bfe6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:53.746502 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d2e25633-cef2-4536-8943-240696a6bfe6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:53.763091 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d2e25633-cef2-4536-8943-240696a6bfe6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:53.765324 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d2e25633-cef2-4536-8943-240696a6bfe6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:53.766781 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d2e25633-cef2-4536-8943-240696a6bfe6 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1733 microversion: 2.20 time: 0.284457 Aug 24 03:36:53.784054 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 348/707] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:53 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1733 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:53.841691 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-a3d4ea23-2591-4f6a-b20b-f2463ce9c4de req-aa4b0b38-22a1-49bb-8804-31429e75e2ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "287e45cb-e736-49a5-9d00-1d603163b29a", "name": "network-vif-plugged", "status": "completed", "tag": "8c0cf45f-a6e0-4319-bf26-59451ac30413"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:36:53.858635 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-a3d4ea23-2591-4f6a-b20b-f2463ce9c4de req-aa4b0b38-22a1-49bb-8804-31429e75e2ad service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:53.860046 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-a3d4ea23-2591-4f6a-b20b-f2463ce9c4de req-aa4b0b38-22a1-49bb-8804-31429e75e2ad service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:53.861056 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-a3d4ea23-2591-4f6a-b20b-f2463ce9c4de req-aa4b0b38-22a1-49bb-8804-31429e75e2ad service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:53.882939 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-a3d4ea23-2591-4f6a-b20b-f2463ce9c4de req-aa4b0b38-22a1-49bb-8804-31429e75e2ad service nova] Creating event network-vif-plugged:8c0cf45f-a6e0-4319-bf26-59451ac30413 for instance 287e45cb-e736-49a5-9d00-1d603163b29a on hv-cinder-85426 Aug 24 03:36:53.889375 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-a3d4ea23-2591-4f6a-b20b-f2463ce9c4de req-aa4b0b38-22a1-49bb-8804-31429e75e2ad service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052238 Aug 24 03:36:53.890802 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 360/708] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:36:54.438545 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0ef837ce-163e-4684-aac2-65393284d73e tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:54.439353 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0ef837ce-163e-4684-aac2-65393284d73e tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] [instance: 287e45cb-e736-49a5-9d00-1d603163b29a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:54.446489 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0ef837ce-163e-4684-aac2-65393284d73e tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:54.448009 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0ef837ce-163e-4684-aac2-65393284d73e tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:54.448907 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0ef837ce-163e-4684-aac2-65393284d73e tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:54.449684 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0ef837ce-163e-4684-aac2-65393284d73e tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:54.450669 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0ef837ce-163e-4684-aac2-65393284d73e tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:54.451187 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0ef837ce-163e-4684-aac2-65393284d73e tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:54.627691 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0ef837ce-163e-4684-aac2-65393284d73e tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467f45f0cfdb4ef58f893e633075e3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e2d5c2e0ce43f9b352daee2f2bf5f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:54.635900 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0ef837ce-163e-4684-aac2-65393284d73e tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] 10.222.0.81 "GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a" status: 200 len: 1315 microversion: 2.1 time: 0.201385 Aug 24 03:36:54.636463 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 349/709] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:54 2022] GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:54.796715 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-ecc70937-86e9-4b87-9a92-9c61944edee7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:54.797576 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-ecc70937-86e9-4b87-9a92-9c61944edee7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:54.805630 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ecc70937-86e9-4b87-9a92-9c61944edee7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:54.807200 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ecc70937-86e9-4b87-9a92-9c61944edee7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:54.807863 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ecc70937-86e9-4b87-9a92-9c61944edee7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:54.809323 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ecc70937-86e9-4b87-9a92-9c61944edee7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:54.810282 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ecc70937-86e9-4b87-9a92-9c61944edee7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:54.811010 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ecc70937-86e9-4b87-9a92-9c61944edee7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:55.021913 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-ecc70937-86e9-4b87-9a92-9c61944edee7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:55.030975 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-ecc70937-86e9-4b87-9a92-9c61944edee7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:55.032632 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-ecc70937-86e9-4b87-9a92-9c61944edee7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:55.033903 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-ecc70937-86e9-4b87-9a92-9c61944edee7 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1733 microversion: 2.20 time: 0.243326 Aug 24 03:36:55.034795 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 361/710] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:54 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1733 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:36:55.656974 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-e6be5f09-1707-4e62-a1fd-c3f521db436e tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:55.657593 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-e6be5f09-1707-4e62-a1fd-c3f521db436e tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] [instance: 287e45cb-e736-49a5-9d00-1d603163b29a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:55.664083 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e6be5f09-1707-4e62-a1fd-c3f521db436e tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:55.664583 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e6be5f09-1707-4e62-a1fd-c3f521db436e tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:55.665054 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e6be5f09-1707-4e62-a1fd-c3f521db436e tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:55.665814 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e6be5f09-1707-4e62-a1fd-c3f521db436e tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:55.666274 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e6be5f09-1707-4e62-a1fd-c3f521db436e tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:55.666854 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e6be5f09-1707-4e62-a1fd-c3f521db436e tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:55.811488 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-e6be5f09-1707-4e62-a1fd-c3f521db436e tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467f45f0cfdb4ef58f893e633075e3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e2d5c2e0ce43f9b352daee2f2bf5f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:55.821009 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-e6be5f09-1707-4e62-a1fd-c3f521db436e tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] 10.222.0.81 "GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a" status: 200 len: 1315 microversion: 2.1 time: 0.167921 Aug 24 03:36:55.823755 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 350/711] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:55 2022] GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:56.057452 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-098d233c-6ee5-420a-b79c-326e55dc06b9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:56.058516 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-098d233c-6ee5-420a-b79c-326e55dc06b9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:56.065290 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-098d233c-6ee5-420a-b79c-326e55dc06b9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:56.065791 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-098d233c-6ee5-420a-b79c-326e55dc06b9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:56.066217 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-098d233c-6ee5-420a-b79c-326e55dc06b9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:56.066915 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-098d233c-6ee5-420a-b79c-326e55dc06b9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:56.067361 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-098d233c-6ee5-420a-b79c-326e55dc06b9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:56.067780 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-098d233c-6ee5-420a-b79c-326e55dc06b9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:56.216598 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-098d233c-6ee5-420a-b79c-326e55dc06b9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:56.225165 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-098d233c-6ee5-420a-b79c-326e55dc06b9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:56.226792 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-098d233c-6ee5-420a-b79c-326e55dc06b9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:56.228044 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-098d233c-6ee5-420a-b79c-326e55dc06b9 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1733 microversion: 2.20 time: 0.175274 Aug 24 03:36:56.229241 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 362/712] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:56 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1733 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:56.843980 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7653a6d9-4a01-4f82-b0ec-f99ea11aedc0 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:56.844609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-7653a6d9-4a01-4f82-b0ec-f99ea11aedc0 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] [instance: 287e45cb-e736-49a5-9d00-1d603163b29a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:56.851059 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7653a6d9-4a01-4f82-b0ec-f99ea11aedc0 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:56.851536 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7653a6d9-4a01-4f82-b0ec-f99ea11aedc0 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:56.851966 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7653a6d9-4a01-4f82-b0ec-f99ea11aedc0 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:56.852648 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7653a6d9-4a01-4f82-b0ec-f99ea11aedc0 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:56.853141 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7653a6d9-4a01-4f82-b0ec-f99ea11aedc0 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:56.853817 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7653a6d9-4a01-4f82-b0ec-f99ea11aedc0 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:56.982218 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-7653a6d9-4a01-4f82-b0ec-f99ea11aedc0 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467f45f0cfdb4ef58f893e633075e3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e2d5c2e0ce43f9b352daee2f2bf5f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:56.990768 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-7653a6d9-4a01-4f82-b0ec-f99ea11aedc0 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] 10.222.0.81 "GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a" status: 200 len: 1315 microversion: 2.1 time: 0.150742 Aug 24 03:36:56.991736 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 351/713] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:56 2022] GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:36:57.252757 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-07887665-d805-4a8b-a30c-f87689658cfd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:57.253680 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-07887665-d805-4a8b-a30c-f87689658cfd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:57.261994 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-07887665-d805-4a8b-a30c-f87689658cfd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:57.262892 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-07887665-d805-4a8b-a30c-f87689658cfd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:57.263339 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-07887665-d805-4a8b-a30c-f87689658cfd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:57.264118 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-07887665-d805-4a8b-a30c-f87689658cfd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:57.264606 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-07887665-d805-4a8b-a30c-f87689658cfd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:57.265046 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-07887665-d805-4a8b-a30c-f87689658cfd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:57.271686 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:36:57.421271 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-07887665-d805-4a8b-a30c-f87689658cfd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:57.429335 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-07887665-d805-4a8b-a30c-f87689658cfd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:57.430851 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-07887665-d805-4a8b-a30c-f87689658cfd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:57.432042 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-07887665-d805-4a8b-a30c-f87689658cfd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1733 microversion: 2.20 time: 0.183720 Aug 24 03:36:57.432609 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 363/714] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:57 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1733 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:58.011737 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-6ebcad3f-8c1f-42bf-ab55-b2f62262d504 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:58.012401 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-6ebcad3f-8c1f-42bf-ab55-b2f62262d504 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] [instance: 287e45cb-e736-49a5-9d00-1d603163b29a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:58.018772 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6ebcad3f-8c1f-42bf-ab55-b2f62262d504 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:58.019260 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6ebcad3f-8c1f-42bf-ab55-b2f62262d504 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:58.019703 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6ebcad3f-8c1f-42bf-ab55-b2f62262d504 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:58.020395 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6ebcad3f-8c1f-42bf-ab55-b2f62262d504 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:58.020887 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6ebcad3f-8c1f-42bf-ab55-b2f62262d504 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:58.021321 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6ebcad3f-8c1f-42bf-ab55-b2f62262d504 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:58.151643 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-6ebcad3f-8c1f-42bf-ab55-b2f62262d504 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467f45f0cfdb4ef58f893e633075e3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e2d5c2e0ce43f9b352daee2f2bf5f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:58.159157 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-6ebcad3f-8c1f-42bf-ab55-b2f62262d504 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] 10.222.0.81 "GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a" status: 200 len: 1315 microversion: 2.1 time: 0.151469 Aug 24 03:36:58.159717 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 352/715] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:58 2022] GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:58.455392 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-191afd71-bfe2-4444-9d31-f24c789ae91e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:58.456001 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-191afd71-bfe2-4444-9d31-f24c789ae91e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:58.462337 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-191afd71-bfe2-4444-9d31-f24c789ae91e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:58.464019 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-191afd71-bfe2-4444-9d31-f24c789ae91e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:58.464457 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-191afd71-bfe2-4444-9d31-f24c789ae91e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:58.465199 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-191afd71-bfe2-4444-9d31-f24c789ae91e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:58.465650 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-191afd71-bfe2-4444-9d31-f24c789ae91e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:58.466079 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-191afd71-bfe2-4444-9d31-f24c789ae91e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:58.609127 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-191afd71-bfe2-4444-9d31-f24c789ae91e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:58.617878 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-191afd71-bfe2-4444-9d31-f24c789ae91e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:58.619946 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-191afd71-bfe2-4444-9d31-f24c789ae91e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:58.621442 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-191afd71-bfe2-4444-9d31-f24c789ae91e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1733 microversion: 2.20 time: 0.170196 Aug 24 03:36:58.637633 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 364/716] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:58 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1733 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:36:59.182436 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b538a78e-7599-4bcf-8993-be8ede310b45 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:59.183135 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-b538a78e-7599-4bcf-8993-be8ede310b45 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] [instance: 287e45cb-e736-49a5-9d00-1d603163b29a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:59.189496 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b538a78e-7599-4bcf-8993-be8ede310b45 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:59.189976 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b538a78e-7599-4bcf-8993-be8ede310b45 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:59.190405 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b538a78e-7599-4bcf-8993-be8ede310b45 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:59.191117 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b538a78e-7599-4bcf-8993-be8ede310b45 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:59.191566 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b538a78e-7599-4bcf-8993-be8ede310b45 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:59.191982 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b538a78e-7599-4bcf-8993-be8ede310b45 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:59.333049 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-b538a78e-7599-4bcf-8993-be8ede310b45 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467f45f0cfdb4ef58f893e633075e3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e2d5c2e0ce43f9b352daee2f2bf5f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:59.342695 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-b538a78e-7599-4bcf-8993-be8ede310b45 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] 10.222.0.81 "GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a" status: 200 len: 1315 microversion: 2.1 time: 0.164578 Aug 24 03:36:59.343622 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 353/717] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:36:59 2022] GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:36:59.645101 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-2aeac10c-d6c0-498a-aef8-3307e54fbf63 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:36:59.645771 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-2aeac10c-d6c0-498a-aef8-3307e54fbf63 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:36:59.652727 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2aeac10c-d6c0-498a-aef8-3307e54fbf63 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:59.653243 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2aeac10c-d6c0-498a-aef8-3307e54fbf63 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:59.653679 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2aeac10c-d6c0-498a-aef8-3307e54fbf63 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:59.654369 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2aeac10c-d6c0-498a-aef8-3307e54fbf63 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:36:59.654825 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2aeac10c-d6c0-498a-aef8-3307e54fbf63 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:36:59.655253 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2aeac10c-d6c0-498a-aef8-3307e54fbf63 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:36:59.793302 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-2aeac10c-d6c0-498a-aef8-3307e54fbf63 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:59.808857 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-2aeac10c-d6c0-498a-aef8-3307e54fbf63 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:59.810825 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-2aeac10c-d6c0-498a-aef8-3307e54fbf63 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:36:59.812192 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-2aeac10c-d6c0-498a-aef8-3307e54fbf63 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1733 microversion: 2.20 time: 0.171347 Aug 24 03:36:59.812793 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 365/718] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:36:59 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1733 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:00.364197 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d79c372d-5622-46a6-8c42-f4f6d8c9684d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:00.364869 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d79c372d-5622-46a6-8c42-f4f6d8c9684d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] [instance: 287e45cb-e736-49a5-9d00-1d603163b29a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:00.371849 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d79c372d-5622-46a6-8c42-f4f6d8c9684d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:00.372325 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d79c372d-5622-46a6-8c42-f4f6d8c9684d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:00.372781 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d79c372d-5622-46a6-8c42-f4f6d8c9684d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:00.373470 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d79c372d-5622-46a6-8c42-f4f6d8c9684d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:00.373918 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d79c372d-5622-46a6-8c42-f4f6d8c9684d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:00.374339 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d79c372d-5622-46a6-8c42-f4f6d8c9684d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:00.533856 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d79c372d-5622-46a6-8c42-f4f6d8c9684d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467f45f0cfdb4ef58f893e633075e3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e2d5c2e0ce43f9b352daee2f2bf5f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:00.541901 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d79c372d-5622-46a6-8c42-f4f6d8c9684d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] 10.222.0.81 "GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a" status: 200 len: 1315 microversion: 2.1 time: 0.181515 Aug 24 03:37:00.542767 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 354/719] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:00 2022] GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:00.835126 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-6d56463a-4370-47fd-b0d7-00d0375b13d5 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:00.836352 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-6d56463a-4370-47fd-b0d7-00d0375b13d5 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:00.844640 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6d56463a-4370-47fd-b0d7-00d0375b13d5 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:00.845185 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6d56463a-4370-47fd-b0d7-00d0375b13d5 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:00.845898 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6d56463a-4370-47fd-b0d7-00d0375b13d5 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:00.846626 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6d56463a-4370-47fd-b0d7-00d0375b13d5 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:00.847085 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6d56463a-4370-47fd-b0d7-00d0375b13d5 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:00.847657 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6d56463a-4370-47fd-b0d7-00d0375b13d5 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:01.002949 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-6d56463a-4370-47fd-b0d7-00d0375b13d5 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:01.013222 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-6d56463a-4370-47fd-b0d7-00d0375b13d5 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:01.015343 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-6d56463a-4370-47fd-b0d7-00d0375b13d5 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:01.017035 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-6d56463a-4370-47fd-b0d7-00d0375b13d5 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1733 microversion: 2.20 time: 0.185610 Aug 24 03:37:01.032614 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 366/720] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:00 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1733 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:01.563845 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a63e2023-a820-451b-8448-8818df688a42 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:01.564642 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a63e2023-a820-451b-8448-8818df688a42 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] [instance: 287e45cb-e736-49a5-9d00-1d603163b29a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:01.571647 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a63e2023-a820-451b-8448-8818df688a42 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:01.573197 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a63e2023-a820-451b-8448-8818df688a42 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:01.573882 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a63e2023-a820-451b-8448-8818df688a42 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:01.574971 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a63e2023-a820-451b-8448-8818df688a42 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:01.575660 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a63e2023-a820-451b-8448-8818df688a42 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:01.576535 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a63e2023-a820-451b-8448-8818df688a42 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:01.724984 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a63e2023-a820-451b-8448-8818df688a42 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467f45f0cfdb4ef58f893e633075e3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e2d5c2e0ce43f9b352daee2f2bf5f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:01.734080 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a63e2023-a820-451b-8448-8818df688a42 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] 10.222.0.81 "GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a" status: 200 len: 1315 microversion: 2.1 time: 0.174057 Aug 24 03:37:01.734669 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 355/721] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:01 2022] GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:02.040496 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-3a2c2c3b-21cc-40f4-a434-84b7f40288ec tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:02.043459 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-3a2c2c3b-21cc-40f4-a434-84b7f40288ec tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:02.050645 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3a2c2c3b-21cc-40f4-a434-84b7f40288ec tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:02.051242 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3a2c2c3b-21cc-40f4-a434-84b7f40288ec tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:02.051756 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3a2c2c3b-21cc-40f4-a434-84b7f40288ec tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:02.052594 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3a2c2c3b-21cc-40f4-a434-84b7f40288ec tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:02.053439 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3a2c2c3b-21cc-40f4-a434-84b7f40288ec tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:02.053886 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3a2c2c3b-21cc-40f4-a434-84b7f40288ec tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:02.199776 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-3a2c2c3b-21cc-40f4-a434-84b7f40288ec tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:02.208296 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-3a2c2c3b-21cc-40f4-a434-84b7f40288ec tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:02.209758 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-3a2c2c3b-21cc-40f4-a434-84b7f40288ec tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:02.210953 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-3a2c2c3b-21cc-40f4-a434-84b7f40288ec tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1733 microversion: 2.20 time: 0.174968 Aug 24 03:37:02.211520 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 367/722] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:02 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1733 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:02.757303 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-82b33618-6622-4877-8b3e-506a29699a55 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:02.757890 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-82b33618-6622-4877-8b3e-506a29699a55 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] [instance: 287e45cb-e736-49a5-9d00-1d603163b29a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:02.764940 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-82b33618-6622-4877-8b3e-506a29699a55 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:02.765417 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-82b33618-6622-4877-8b3e-506a29699a55 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:02.765851 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-82b33618-6622-4877-8b3e-506a29699a55 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:02.766536 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-82b33618-6622-4877-8b3e-506a29699a55 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:02.766987 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-82b33618-6622-4877-8b3e-506a29699a55 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:02.767407 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-82b33618-6622-4877-8b3e-506a29699a55 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:02.895711 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-82b33618-6622-4877-8b3e-506a29699a55 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467f45f0cfdb4ef58f893e633075e3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e2d5c2e0ce43f9b352daee2f2bf5f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:02.903459 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-82b33618-6622-4877-8b3e-506a29699a55 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] 10.222.0.81 "GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a" status: 200 len: 1315 microversion: 2.1 time: 0.150052 Aug 24 03:37:02.904016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 356/723] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:02 2022] GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:03.236879 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-8e55577c-31f5-45c5-b0ca-fc8f500f7c3a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:03.237489 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-8e55577c-31f5-45c5-b0ca-fc8f500f7c3a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:03.243848 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8e55577c-31f5-45c5-b0ca-fc8f500f7c3a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:03.244380 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8e55577c-31f5-45c5-b0ca-fc8f500f7c3a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:03.244869 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8e55577c-31f5-45c5-b0ca-fc8f500f7c3a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:03.245536 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8e55577c-31f5-45c5-b0ca-fc8f500f7c3a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:03.245964 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8e55577c-31f5-45c5-b0ca-fc8f500f7c3a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:03.246381 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8e55577c-31f5-45c5-b0ca-fc8f500f7c3a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:03.379828 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-8e55577c-31f5-45c5-b0ca-fc8f500f7c3a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:03.388406 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-8e55577c-31f5-45c5-b0ca-fc8f500f7c3a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:03.389947 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-8e55577c-31f5-45c5-b0ca-fc8f500f7c3a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:03.391091 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-8e55577c-31f5-45c5-b0ca-fc8f500f7c3a tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1733 microversion: 2.20 time: 0.158153 Aug 24 03:37:03.391657 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 368/724] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:03 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:03.925317 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a003fe60-b8ad-4c12-92c0-bd0b847d9830 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:03.925923 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a003fe60-b8ad-4c12-92c0-bd0b847d9830 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] [instance: 287e45cb-e736-49a5-9d00-1d603163b29a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:03.931901 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a003fe60-b8ad-4c12-92c0-bd0b847d9830 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:03.932371 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a003fe60-b8ad-4c12-92c0-bd0b847d9830 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:03.932826 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a003fe60-b8ad-4c12-92c0-bd0b847d9830 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:03.933506 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a003fe60-b8ad-4c12-92c0-bd0b847d9830 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:03.933949 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a003fe60-b8ad-4c12-92c0-bd0b847d9830 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:03.934364 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a003fe60-b8ad-4c12-92c0-bd0b847d9830 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:04.060841 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a003fe60-b8ad-4c12-92c0-bd0b847d9830 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467f45f0cfdb4ef58f893e633075e3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e2d5c2e0ce43f9b352daee2f2bf5f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:04.068580 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a003fe60-b8ad-4c12-92c0-bd0b847d9830 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] 10.222.0.81 "GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a" status: 200 len: 1315 microversion: 2.1 time: 0.147207 Aug 24 03:37:04.069200 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 357/725] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:03 2022] GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:04.414569 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-14ec3aa2-575b-4b69-bf2b-12fbcad6eaf1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:04.415169 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-14ec3aa2-575b-4b69-bf2b-12fbcad6eaf1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:04.421484 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-14ec3aa2-575b-4b69-bf2b-12fbcad6eaf1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:04.421957 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-14ec3aa2-575b-4b69-bf2b-12fbcad6eaf1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:04.422377 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-14ec3aa2-575b-4b69-bf2b-12fbcad6eaf1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:04.423061 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-14ec3aa2-575b-4b69-bf2b-12fbcad6eaf1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:04.423506 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-14ec3aa2-575b-4b69-bf2b-12fbcad6eaf1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:04.423921 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-14ec3aa2-575b-4b69-bf2b-12fbcad6eaf1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:04.554087 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-14ec3aa2-575b-4b69-bf2b-12fbcad6eaf1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:04.562838 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-14ec3aa2-575b-4b69-bf2b-12fbcad6eaf1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:04.564338 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-14ec3aa2-575b-4b69-bf2b-12fbcad6eaf1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:04.565521 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-14ec3aa2-575b-4b69-bf2b-12fbcad6eaf1 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1733 microversion: 2.20 time: 0.154873 Aug 24 03:37:04.566081 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 369/726] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:04 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:05.090203 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c3554056-f244-4cc9-bbc9-e771a4eed2cb tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:05.090809 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c3554056-f244-4cc9-bbc9-e771a4eed2cb tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] [instance: 287e45cb-e736-49a5-9d00-1d603163b29a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:05.097425 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c3554056-f244-4cc9-bbc9-e771a4eed2cb tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:05.097898 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c3554056-f244-4cc9-bbc9-e771a4eed2cb tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:05.098328 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c3554056-f244-4cc9-bbc9-e771a4eed2cb tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:05.099005 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c3554056-f244-4cc9-bbc9-e771a4eed2cb tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:05.099482 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c3554056-f244-4cc9-bbc9-e771a4eed2cb tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:05.099901 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c3554056-f244-4cc9-bbc9-e771a4eed2cb tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:05.103897 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=98 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:05.235349 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c3554056-f244-4cc9-bbc9-e771a4eed2cb tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467f45f0cfdb4ef58f893e633075e3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e2d5c2e0ce43f9b352daee2f2bf5f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:05.242888 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c3554056-f244-4cc9-bbc9-e771a4eed2cb tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] 10.222.0.81 "GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a" status: 200 len: 1315 microversion: 2.1 time: 0.157361 Aug 24 03:37:05.243449 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 358/727] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:05 2022] GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:05.589920 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-13f7fa20-b06b-47a2-af72-b07d948c35c0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:05.590538 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-13f7fa20-b06b-47a2-af72-b07d948c35c0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:05.597294 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-13f7fa20-b06b-47a2-af72-b07d948c35c0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:05.597788 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-13f7fa20-b06b-47a2-af72-b07d948c35c0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:05.598235 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-13f7fa20-b06b-47a2-af72-b07d948c35c0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:05.598974 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-13f7fa20-b06b-47a2-af72-b07d948c35c0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:05.599434 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-13f7fa20-b06b-47a2-af72-b07d948c35c0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:05.599864 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-13f7fa20-b06b-47a2-af72-b07d948c35c0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:05.746483 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-13f7fa20-b06b-47a2-af72-b07d948c35c0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:05.756129 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-13f7fa20-b06b-47a2-af72-b07d948c35c0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:05.757658 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-13f7fa20-b06b-47a2-af72-b07d948c35c0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:05.758860 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-13f7fa20-b06b-47a2-af72-b07d948c35c0 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1733 microversion: 2.20 time: 0.173953 Aug 24 03:37:05.759423 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 370/728] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:05 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1733 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:06.263912 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-88d560d8-4663-4b83-b53b-0546a6d2656b tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:06.264547 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-88d560d8-4663-4b83-b53b-0546a6d2656b tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] [instance: 287e45cb-e736-49a5-9d00-1d603163b29a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:06.270954 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-88d560d8-4663-4b83-b53b-0546a6d2656b tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:06.271436 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-88d560d8-4663-4b83-b53b-0546a6d2656b tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:06.271870 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-88d560d8-4663-4b83-b53b-0546a6d2656b tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:06.272575 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-88d560d8-4663-4b83-b53b-0546a6d2656b tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:06.273062 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-88d560d8-4663-4b83-b53b-0546a6d2656b tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:06.273488 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-88d560d8-4663-4b83-b53b-0546a6d2656b tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:06.403367 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-88d560d8-4663-4b83-b53b-0546a6d2656b tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467f45f0cfdb4ef58f893e633075e3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e2d5c2e0ce43f9b352daee2f2bf5f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:06.410895 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-88d560d8-4663-4b83-b53b-0546a6d2656b tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] 10.222.0.81 "GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a" status: 200 len: 1465 microversion: 2.1 time: 0.151527 Aug 24 03:37:06.411453 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 359/729] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:06 2022] GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a => generated 1465 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:06.456587 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-a2a757ca-e437-480c-857b-95b6cf252420 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:06.457112 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-a2a757ca-e437-480c-857b-95b6cf252420 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] [instance: 287e45cb-e736-49a5-9d00-1d603163b29a] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:06.463563 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a2a757ca-e437-480c-857b-95b6cf252420 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:06.464144 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a2a757ca-e437-480c-857b-95b6cf252420 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:06.464578 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a2a757ca-e437-480c-857b-95b6cf252420 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:06.465288 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a2a757ca-e437-480c-857b-95b6cf252420 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:06.465738 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a2a757ca-e437-480c-857b-95b6cf252420 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:06.466163 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a2a757ca-e437-480c-857b-95b6cf252420 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:06.490093 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-a2a757ca-e437-480c-857b-95b6cf252420 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] [instance: 287e45cb-e736-49a5-9d00-1d603163b29a] Going to try to terminate instance {{(pid=120709) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:37:06.562680 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-a2a757ca-e437-480c-857b-95b6cf252420 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] 10.222.0.81 "DELETE /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a" status: 204 len: 0 microversion: 2.1 time: 0.109485 Aug 24 03:37:06.563179 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 371/730] 10.222.0.81 () {58 vars in 1239 bytes} [Wed Aug 24 03:37:06 2022] DELETE /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:37:06.572113 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-865b7de3-f6e1-4d0d-b955-a0b4f5b3198b tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:06.573368 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-865b7de3-f6e1-4d0d-b955-a0b4f5b3198b tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] [instance: 287e45cb-e736-49a5-9d00-1d603163b29a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:06.579206 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-865b7de3-f6e1-4d0d-b955-a0b4f5b3198b tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:06.579688 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-865b7de3-f6e1-4d0d-b955-a0b4f5b3198b tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:06.580121 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-865b7de3-f6e1-4d0d-b955-a0b4f5b3198b tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:06.580835 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-865b7de3-f6e1-4d0d-b955-a0b4f5b3198b tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:06.581289 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-865b7de3-f6e1-4d0d-b955-a0b4f5b3198b tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:06.581713 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-865b7de3-f6e1-4d0d-b955-a0b4f5b3198b tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:06.783290 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-e168f6ac-b8d7-4356-9a0f-d7c97319833d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:06.783982 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-e168f6ac-b8d7-4356-9a0f-d7c97319833d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:06.790360 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e168f6ac-b8d7-4356-9a0f-d7c97319833d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:06.790840 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e168f6ac-b8d7-4356-9a0f-d7c97319833d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:06.791332 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e168f6ac-b8d7-4356-9a0f-d7c97319833d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:06.792023 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e168f6ac-b8d7-4356-9a0f-d7c97319833d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:06.792493 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e168f6ac-b8d7-4356-9a0f-d7c97319833d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:06.792922 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e168f6ac-b8d7-4356-9a0f-d7c97319833d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:06.904072 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-865b7de3-f6e1-4d0d-b955-a0b4f5b3198b tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467f45f0cfdb4ef58f893e633075e3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e2d5c2e0ce43f9b352daee2f2bf5f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:06.912386 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-865b7de3-f6e1-4d0d-b955-a0b4f5b3198b tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] 10.222.0.81 "GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a" status: 200 len: 1471 microversion: 2.1 time: 0.344140 Aug 24 03:37:06.912681 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 360/731] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:06 2022] GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a => generated 1471 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:06.948699 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-e168f6ac-b8d7-4356-9a0f-d7c97319833d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:06.956978 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-e168f6ac-b8d7-4356-9a0f-d7c97319833d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:06.958526 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-e168f6ac-b8d7-4356-9a0f-d7c97319833d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:06.959677 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-e168f6ac-b8d7-4356-9a0f-d7c97319833d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1733 microversion: 2.20 time: 0.180759 Aug 24 03:37:06.960237 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 372/732] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:06 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1733 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:37:07.774335 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-1d211cb9-51af-4428-8c0a-ad337ee8703c req-616acc76-1aa2-401e-ba3a-9d5115937a63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4", "name": "network-vif-plugged", "status": "completed", "tag": "c49bffe3-b213-40d0-a914-6759e188a044"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:07.785398 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-1d211cb9-51af-4428-8c0a-ad337ee8703c req-616acc76-1aa2-401e-ba3a-9d5115937a63 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:07.785904 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-1d211cb9-51af-4428-8c0a-ad337ee8703c req-616acc76-1aa2-401e-ba3a-9d5115937a63 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:07.786954 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-1d211cb9-51af-4428-8c0a-ad337ee8703c req-616acc76-1aa2-401e-ba3a-9d5115937a63 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:07.799665 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-1d211cb9-51af-4428-8c0a-ad337ee8703c req-616acc76-1aa2-401e-ba3a-9d5115937a63 service nova] Creating event network-vif-plugged:c49bffe3-b213-40d0-a914-6759e188a044 for instance a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 on hv-cinder-85426 Aug 24 03:37:07.805242 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-1d211cb9-51af-4428-8c0a-ad337ee8703c req-616acc76-1aa2-401e-ba3a-9d5115937a63 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034503 Aug 24 03:37:07.805829 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 361/733] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:07.932592 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-ce6be157-1c1a-4872-8654-2af21fcc1174 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:07.933239 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-ce6be157-1c1a-4872-8654-2af21fcc1174 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] [instance: 287e45cb-e736-49a5-9d00-1d603163b29a] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:07.939596 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ce6be157-1c1a-4872-8654-2af21fcc1174 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:07.940083 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ce6be157-1c1a-4872-8654-2af21fcc1174 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:07.940527 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ce6be157-1c1a-4872-8654-2af21fcc1174 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:07.941255 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ce6be157-1c1a-4872-8654-2af21fcc1174 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:07.941715 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ce6be157-1c1a-4872-8654-2af21fcc1174 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:07.942168 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ce6be157-1c1a-4872-8654-2af21fcc1174 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:07.984236 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-9b56646c-6aa5-4fb0-94f8-1ddc92b3028b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:07.985498 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-9b56646c-6aa5-4fb0-94f8-1ddc92b3028b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:07.992442 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9b56646c-6aa5-4fb0-94f8-1ddc92b3028b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:07.993007 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9b56646c-6aa5-4fb0-94f8-1ddc92b3028b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:07.993630 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9b56646c-6aa5-4fb0-94f8-1ddc92b3028b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:07.994579 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9b56646c-6aa5-4fb0-94f8-1ddc92b3028b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:07.995025 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9b56646c-6aa5-4fb0-94f8-1ddc92b3028b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:07.995694 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9b56646c-6aa5-4fb0-94f8-1ddc92b3028b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:08.128461 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-ce6be157-1c1a-4872-8654-2af21fcc1174 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467f45f0cfdb4ef58f893e633075e3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e2d5c2e0ce43f9b352daee2f2bf5f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:08.141958 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-ce6be157-1c1a-4872-8654-2af21fcc1174 tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] 10.222.0.81 "GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a" status: 200 len: 1471 microversion: 2.1 time: 0.213223 Aug 24 03:37:08.142621 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 373/734] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:07 2022] GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a => generated 1471 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:08.166879 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-9b56646c-6aa5-4fb0-94f8-1ddc92b3028b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:08.175499 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-9b56646c-6aa5-4fb0-94f8-1ddc92b3028b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:08.177030 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-9b56646c-6aa5-4fb0-94f8-1ddc92b3028b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:08.178192 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-9b56646c-6aa5-4fb0-94f8-1ddc92b3028b tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1733 microversion: 2.20 time: 0.198385 Aug 24 03:37:08.178910 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 362/735] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:07 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1733 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:37:08.673843 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-46802f80-1b24-42b8-b146-c1adf46ae911 req-7adb4f20-a9eb-472d-bbc8-67624c7b7697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "287e45cb-e736-49a5-9d00-1d603163b29a", "name": "network-vif-deleted", "tag": "8c0cf45f-a6e0-4319-bf26-59451ac30413"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:08.686369 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-46802f80-1b24-42b8-b146-c1adf46ae911 req-7adb4f20-a9eb-472d-bbc8-67624c7b7697 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:08.686857 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-46802f80-1b24-42b8-b146-c1adf46ae911 req-7adb4f20-a9eb-472d-bbc8-67624c7b7697 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:08.687292 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-46802f80-1b24-42b8-b146-c1adf46ae911 req-7adb4f20-a9eb-472d-bbc8-67624c7b7697 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:08.699640 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-46802f80-1b24-42b8-b146-c1adf46ae911 req-7adb4f20-a9eb-472d-bbc8-67624c7b7697 service nova] Creating event network-vif-deleted:8c0cf45f-a6e0-4319-bf26-59451ac30413 for instance 287e45cb-e736-49a5-9d00-1d603163b29a on hv-cinder-85426 Aug 24 03:37:08.704695 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-46802f80-1b24-42b8-b146-c1adf46ae911 req-7adb4f20-a9eb-472d-bbc8-67624c7b7697 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039658 Aug 24 03:37:08.705428 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 374/736] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:09.163849 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7dcf2ce3-b2a3-4d24-b5da-ca1e57c5247f tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:09.164471 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-7dcf2ce3-b2a3-4d24-b5da-ca1e57c5247f tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] [instance: 287e45cb-e736-49a5-9d00-1d603163b29a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:09.171601 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7dcf2ce3-b2a3-4d24-b5da-ca1e57c5247f tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:09.172135 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7dcf2ce3-b2a3-4d24-b5da-ca1e57c5247f tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:09.172580 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7dcf2ce3-b2a3-4d24-b5da-ca1e57c5247f tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:09.173316 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7dcf2ce3-b2a3-4d24-b5da-ca1e57c5247f tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:09.173775 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7dcf2ce3-b2a3-4d24-b5da-ca1e57c5247f tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:09.174201 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7dcf2ce3-b2a3-4d24-b5da-ca1e57c5247f tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:09.203896 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-fd307a6f-b9ae-422a-8cf1-53c7557b9364 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:09.204645 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-fd307a6f-b9ae-422a-8cf1-53c7557b9364 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:09.205513 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7dcf2ce3-b2a3-4d24-b5da-ca1e57c5247f tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:09.206003 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7dcf2ce3-b2a3-4d24-b5da-ca1e57c5247f tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:09.206443 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7dcf2ce3-b2a3-4d24-b5da-ca1e57c5247f tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:09.206890 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.objects.instance [None req-7dcf2ce3-b2a3-4d24-b5da-ca1e57c5247f tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lazy-loading 'fault' on Instance uuid 287e45cb-e736-49a5-9d00-1d603163b29a {{(pid=120708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:37:09.211041 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fd307a6f-b9ae-422a-8cf1-53c7557b9364 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:09.211558 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fd307a6f-b9ae-422a-8cf1-53c7557b9364 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:09.212017 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fd307a6f-b9ae-422a-8cf1-53c7557b9364 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:09.213285 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fd307a6f-b9ae-422a-8cf1-53c7557b9364 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:09.213912 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fd307a6f-b9ae-422a-8cf1-53c7557b9364 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:09.214398 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fd307a6f-b9ae-422a-8cf1-53c7557b9364 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:09.251084 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-7dcf2ce3-b2a3-4d24-b5da-ca1e57c5247f tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467f45f0cfdb4ef58f893e633075e3ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e2d5c2e0ce43f9b352daee2f2bf5f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:09.259317 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-7dcf2ce3-b2a3-4d24-b5da-ca1e57c5247f tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] 10.222.0.81 "GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a" status: 200 len: 1305 microversion: 2.1 time: 0.099283 Aug 24 03:37:09.260045 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 363/737] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:09 2022] GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a => generated 1305 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:09.347150 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-fd307a6f-b9ae-422a-8cf1-53c7557b9364 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:09.355319 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-fd307a6f-b9ae-422a-8cf1-53c7557b9364 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:09.356861 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-fd307a6f-b9ae-422a-8cf1-53c7557b9364 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:09.358010 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-fd307a6f-b9ae-422a-8cf1-53c7557b9364 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1733 microversion: 2.20 time: 0.159028 Aug 24 03:37:09.358559 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 375/738] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:09 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:37:10.283702 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-00617506-fb2e-447c-ba72-fbd3ed3fa24d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:10.284270 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-00617506-fb2e-447c-ba72-fbd3ed3fa24d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] [instance: 287e45cb-e736-49a5-9d00-1d603163b29a] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:10.291956 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-00617506-fb2e-447c-ba72-fbd3ed3fa24d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:10.292684 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-00617506-fb2e-447c-ba72-fbd3ed3fa24d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:10.293373 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-00617506-fb2e-447c-ba72-fbd3ed3fa24d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:10.294426 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-00617506-fb2e-447c-ba72-fbd3ed3fa24d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:10.295113 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-00617506-fb2e-447c-ba72-fbd3ed3fa24d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:10.295762 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-00617506-fb2e-447c-ba72-fbd3ed3fa24d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:10.312435 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-00617506-fb2e-447c-ba72-fbd3ed3fa24d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] HTTP exception thrown: Instance 287e45cb-e736-49a5-9d00-1d603163b29a could not be found. Aug 24 03:37:10.315140 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-00617506-fb2e-447c-ba72-fbd3ed3fa24d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Request method failure captured: Aug 24 03:37:10.315140 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a HTTP/1.1 Aug 24 03:37:10.315140 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 24 03:37:10.315140 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 24 03:37:10.315140 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Connection: close Aug 24 03:37:10.315140 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 24 03:37:10.315140 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 24 03:37:10.315140 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Host: 10.222.0.81 Aug 24 03:37:10.315140 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 24 03:37:10.315140 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:10.315140 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjBZzIvxfuiyrZh2lsqanSbwGkpszEi3YLO2ieZfOCHbHYeDjBaO0_-rO7k9sn6DakMJvpVVS2uPXIH9Ro62CBDga0p20GRYAS9WthOhDCVLYr1_6Oob_qVJAq4_qDhxoISoN_sY4y-aaNxOLHjDmYlQJl_OoRbPBGLe3qNPKvgf4Myhw Aug 24 03:37:10.315140 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 24 03:37:10.315140 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 24 03:37:10.315140 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 24 03:37:10.315140 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 24 03:37:10.315140 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 24 03:37:10.315140 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 24 03:37:10.315140 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Id: d5e2d5c2e0ce43f9b352daee2f2bf5f9 Aug 24 03:37:10.315140 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-VolumesNegativeTest-82845569 Aug 24 03:37:10.315140 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 24 03:37:10.315140 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 24 03:37:10.316699 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d5e2d5c2e0ce43f9b352daee2f2bf5f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d5e2d5c2e0ce43f9b352daee2f2bf5f9", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d5e2d5c2e0ce43f9b352daee2f2bf5f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d5e2d5c2e0ce43f9b352daee2f2bf5f9"}]}] Aug 24 03:37:10.316699 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-VolumesNegativeTest-82845569 Aug 24 03:37:10.316699 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Id: d5e2d5c2e0ce43f9b352daee2f2bf5f9 Aug 24 03:37:10.316699 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-VolumesNegativeTest-82845569 Aug 24 03:37:10.316699 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User: tempest-VolumesNegativeTest-82845569-project Aug 24 03:37:10.316699 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 24 03:37:10.316699 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 24 03:37:10.316699 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Id: 467f45f0cfdb4ef58f893e633075e3ae Aug 24 03:37:10.316699 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-VolumesNegativeTest-82845569-project Aug 24 03:37:10.316699 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: method: > Aug 24 03:37:10.316699 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: exception: Instance 287e45cb-e736-49a5-9d00-1d603163b29a could not be found. Aug 24 03:37:10.316699 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: action_args: {'id': '287e45cb-e736-49a5-9d00-1d603163b29a'} Aug 24 03:37:10.317668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:10.317668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:10.317668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:37:10.317668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:37:10.317668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:37:10.317668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:37:10.317668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:37:10.317668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:37:10.317668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:37:10.317668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:37:10.317668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 287e45cb-e736-49a5-9d00-1d603163b29a could not be found. Aug 24 03:37:10.317668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:37:10.317668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:10.317668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:37:10.317668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:10.317668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:10.317668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:10.317668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:10.317668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:10.317668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:10.319095 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:10.319095 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:37:10.319095 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:37:10.319095 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:37:10.319095 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:37:10.319095 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:37:10.319095 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:37:10.319095 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 287e45cb-e736-49a5-9d00-1d603163b29a could not be found. Aug 24 03:37:10.319095 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:37:10.319095 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:10.319095 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:37:10.319095 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:10.319095 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:10.319095 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:10.319095 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:37:10.319095 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:37:10.319095 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 287e45cb-e736-49a5-9d00-1d603163b29a could not be found. Aug 24 03:37:10.319095 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:37:10.320441 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-00617506-fb2e-447c-ba72-fbd3ed3fa24d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] Returning 404 to user: Instance 287e45cb-e736-49a5-9d00-1d603163b29a could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:10.320441 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-00617506-fb2e-447c-ba72-fbd3ed3fa24d tempest-VolumesNegativeTest-82845569 tempest-VolumesNegativeTest-82845569-project] 10.222.0.81 "GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a" status: 404 len: 111 microversion: 2.1 time: 0.037805 Aug 24 03:37:10.320441 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 364/739] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:10 2022] GET /compute/v2.1/servers/287e45cb-e736-49a5-9d00-1d603163b29a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:37:10.380697 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-5e05b5da-e97a-4ec9-b636-49ab057a461d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:10.381339 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-5e05b5da-e97a-4ec9-b636-49ab057a461d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:10.388454 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5e05b5da-e97a-4ec9-b636-49ab057a461d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:10.388983 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5e05b5da-e97a-4ec9-b636-49ab057a461d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:10.389424 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5e05b5da-e97a-4ec9-b636-49ab057a461d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:10.390241 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5e05b5da-e97a-4ec9-b636-49ab057a461d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:10.390568 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5e05b5da-e97a-4ec9-b636-49ab057a461d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:10.390996 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5e05b5da-e97a-4ec9-b636-49ab057a461d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:10.525705 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-5e05b5da-e97a-4ec9-b636-49ab057a461d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:10.533998 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-5e05b5da-e97a-4ec9-b636-49ab057a461d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:10.535417 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-5e05b5da-e97a-4ec9-b636-49ab057a461d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:10.536567 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-5e05b5da-e97a-4ec9-b636-49ab057a461d tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1720 microversion: 2.20 time: 0.159716 Aug 24 03:37:10.537136 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 376/740] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:10 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:17.314534 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-30542a73-5d0e-48f6-a8d2-bb643da02afc tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1013995527", "imageRef": "b7a40f0c-20c2-44cd-8b0e-f6e73a007d3e", "flavorRef": "452", "networks": [{"uuid": "d18813c9-12da-4d54-a359-55f756fd2f82"}]}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:17.373090 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.network.neutron [None req-30542a73-5d0e-48f6-a8d2-bb643da02afc tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] validate_networks() for [('d18813c9-12da-4d54-a359-55f756fd2f82', None, None, None, None, None)] {{(pid=120708) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:37:17.960017 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-30542a73-5d0e-48f6-a8d2-bb643da02afc tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Flavor limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:37:17.960468 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-30542a73-5d0e-48f6-a8d2-bb643da02afc tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Image limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:37:17.961001 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-30542a73-5d0e-48f6-a8d2-bb643da02afc tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Flavor pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:37:17.961416 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-30542a73-5d0e-48f6-a8d2-bb643da02afc tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Image pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:37:17.961848 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-30542a73-5d0e-48f6-a8d2-bb643da02afc tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:37:17.971053 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-30542a73-5d0e-48f6-a8d2-bb643da02afc tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:17.971530 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-30542a73-5d0e-48f6-a8d2-bb643da02afc tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:17.971961 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-30542a73-5d0e-48f6-a8d2-bb643da02afc tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:17.972688 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-30542a73-5d0e-48f6-a8d2-bb643da02afc tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:17.973297 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-30542a73-5d0e-48f6-a8d2-bb643da02afc tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:17.973731 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-30542a73-5d0e-48f6-a8d2-bb643da02afc tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:17.990126 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-30542a73-5d0e-48f6-a8d2-bb643da02afc tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Getting quotas for project 69f494a609f241328d85790280b204b8. Resources: {'ram', 'instances', 'cores'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:37:17.994508 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-30542a73-5d0e-48f6-a8d2-bb643da02afc tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Getting quotas for user 5143313cddbb4f56bf48d84167069c74 and project 69f494a609f241328d85790280b204b8. Resources: {'ram', 'instances', 'cores'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:37:18.005079 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-30542a73-5d0e-48f6-a8d2-bb643da02afc tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Going to run 1 instances... {{(pid=120708) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:37:18.007324 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-30542a73-5d0e-48f6-a8d2-bb643da02afc tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: 1de285c1-cf27-4c89-a56a-9d49322e3f42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b7a40f0c-20c2-44cd-8b0e-f6e73a007d3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120708) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:37:18.053208 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-30542a73-5d0e-48f6-a8d2-bb643da02afc tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.742737 Aug 24 03:37:18.053854 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 365/741] 10.222.0.81 () {60 vars in 1147 bytes} [Wed Aug 24 03:37:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:37:18.065373 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-c1d1185b-87bb-494c-b0ed-c59da348b3b3 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:18.066007 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-c1d1185b-87bb-494c-b0ed-c59da348b3b3 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: 1de285c1-cf27-4c89-a56a-9d49322e3f42] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:18.068650 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:18.122292 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-c1d1185b-87bb-494c-b0ed-c59da348b3b3 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5143313cddbb4f56bf48d84167069c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f494a609f241328d85790280b204b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:18.129132 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-c1d1185b-87bb-494c-b0ed-c59da348b3b3 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] 10.222.0.81 "GET /compute/v2.1/servers/1de285c1-cf27-4c89-a56a-9d49322e3f42" status: 200 len: 1219 microversion: 2.1 time: 0.067600 Aug 24 03:37:18.129803 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 377/742] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:18 2022] GET /compute/v2.1/servers/1de285c1-cf27-4c89-a56a-9d49322e3f42 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:19.152435 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-23466d40-2507-41df-94ea-8e1954786632 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:19.153875 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-23466d40-2507-41df-94ea-8e1954786632 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: 1de285c1-cf27-4c89-a56a-9d49322e3f42] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:19.160602 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-23466d40-2507-41df-94ea-8e1954786632 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:19.161215 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-23466d40-2507-41df-94ea-8e1954786632 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:19.161740 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-23466d40-2507-41df-94ea-8e1954786632 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:19.162518 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-23466d40-2507-41df-94ea-8e1954786632 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:19.163069 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-23466d40-2507-41df-94ea-8e1954786632 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:19.163572 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-23466d40-2507-41df-94ea-8e1954786632 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:19.234882 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-23466d40-2507-41df-94ea-8e1954786632 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5143313cddbb4f56bf48d84167069c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f494a609f241328d85790280b204b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:19.244880 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-23466d40-2507-41df-94ea-8e1954786632 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] 10.222.0.81 "GET /compute/v2.1/servers/1de285c1-cf27-4c89-a56a-9d49322e3f42" status: 200 len: 1289 microversion: 2.1 time: 0.097402 Aug 24 03:37:19.245730 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 366/743] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:19 2022] GET /compute/v2.1/servers/1de285c1-cf27-4c89-a56a-9d49322e3f42 => generated 1289 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:20.268054 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-cda91fee-ee6c-449c-a2b4-3f492d4ff490 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:20.268676 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-cda91fee-ee6c-449c-a2b4-3f492d4ff490 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: 1de285c1-cf27-4c89-a56a-9d49322e3f42] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:20.275229 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cda91fee-ee6c-449c-a2b4-3f492d4ff490 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:20.275844 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cda91fee-ee6c-449c-a2b4-3f492d4ff490 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:20.276433 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cda91fee-ee6c-449c-a2b4-3f492d4ff490 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:20.277166 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cda91fee-ee6c-449c-a2b4-3f492d4ff490 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:20.277625 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cda91fee-ee6c-449c-a2b4-3f492d4ff490 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:20.278058 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cda91fee-ee6c-449c-a2b4-3f492d4ff490 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:20.361157 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-c3f973a4-2de7-414a-99dd-2f69256490ac req-456a5aaa-bb48-4cdb-bfa4-d397dd7a4fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1de285c1-cf27-4c89-a56a-9d49322e3f42", "tag": "aa70beb4-13fb-47e3-a96f-69b0fe3a7aec"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:20.373978 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-c3f973a4-2de7-414a-99dd-2f69256490ac req-456a5aaa-bb48-4cdb-bfa4-d397dd7a4fd7 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:20.374493 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-c3f973a4-2de7-414a-99dd-2f69256490ac req-456a5aaa-bb48-4cdb-bfa4-d397dd7a4fd7 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:20.375035 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-c3f973a4-2de7-414a-99dd-2f69256490ac req-456a5aaa-bb48-4cdb-bfa4-d397dd7a4fd7 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:20.388533 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-c3f973a4-2de7-414a-99dd-2f69256490ac req-456a5aaa-bb48-4cdb-bfa4-d397dd7a4fd7 service nova] Creating event network-changed:aa70beb4-13fb-47e3-a96f-69b0fe3a7aec for instance 1de285c1-cf27-4c89-a56a-9d49322e3f42 on hv-cinder-85426 Aug 24 03:37:20.393731 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-c3f973a4-2de7-414a-99dd-2f69256490ac req-456a5aaa-bb48-4cdb-bfa4-d397dd7a4fd7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036526 Aug 24 03:37:20.394314 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 367/744] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:37:20.424080 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-cda91fee-ee6c-449c-a2b4-3f492d4ff490 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5143313cddbb4f56bf48d84167069c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f494a609f241328d85790280b204b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:20.432606 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-cda91fee-ee6c-449c-a2b4-3f492d4ff490 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] 10.222.0.81 "GET /compute/v2.1/servers/1de285c1-cf27-4c89-a56a-9d49322e3f42" status: 200 len: 1319 microversion: 2.1 time: 0.168967 Aug 24 03:37:20.433307 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 378/745] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:20 2022] GET /compute/v2.1/servers/1de285c1-cf27-4c89-a56a-9d49322e3f42 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:21.455255 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f112dbeb-862f-4436-bb51-9e5c0165eebe tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:21.455949 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f112dbeb-862f-4436-bb51-9e5c0165eebe tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: 1de285c1-cf27-4c89-a56a-9d49322e3f42] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:21.457881 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:21.463877 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f112dbeb-862f-4436-bb51-9e5c0165eebe tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:21.464355 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f112dbeb-862f-4436-bb51-9e5c0165eebe tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:21.464806 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f112dbeb-862f-4436-bb51-9e5c0165eebe tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:21.465494 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f112dbeb-862f-4436-bb51-9e5c0165eebe tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:21.465944 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f112dbeb-862f-4436-bb51-9e5c0165eebe tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:21.466618 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f112dbeb-862f-4436-bb51-9e5c0165eebe tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:21.608954 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f112dbeb-862f-4436-bb51-9e5c0165eebe tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5143313cddbb4f56bf48d84167069c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f494a609f241328d85790280b204b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:21.616414 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f112dbeb-862f-4436-bb51-9e5c0165eebe tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] 10.222.0.81 "GET /compute/v2.1/servers/1de285c1-cf27-4c89-a56a-9d49322e3f42" status: 200 len: 1319 microversion: 2.1 time: 0.165793 Aug 24 03:37:21.617008 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 368/746] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:21 2022] GET /compute/v2.1/servers/1de285c1-cf27-4c89-a56a-9d49322e3f42 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:22.637651 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-20e6f6ad-db71-4bcb-9028-bfb860481091 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:22.638793 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-20e6f6ad-db71-4bcb-9028-bfb860481091 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: 1de285c1-cf27-4c89-a56a-9d49322e3f42] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:22.645248 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-20e6f6ad-db71-4bcb-9028-bfb860481091 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:22.645911 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-20e6f6ad-db71-4bcb-9028-bfb860481091 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:22.646348 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-20e6f6ad-db71-4bcb-9028-bfb860481091 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:22.647038 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-20e6f6ad-db71-4bcb-9028-bfb860481091 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:22.647489 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-20e6f6ad-db71-4bcb-9028-bfb860481091 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:22.647907 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-20e6f6ad-db71-4bcb-9028-bfb860481091 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:22.780387 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-20e6f6ad-db71-4bcb-9028-bfb860481091 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5143313cddbb4f56bf48d84167069c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f494a609f241328d85790280b204b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:22.782579 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:22.788973 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-20e6f6ad-db71-4bcb-9028-bfb860481091 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] 10.222.0.81 "GET /compute/v2.1/servers/1de285c1-cf27-4c89-a56a-9d49322e3f42" status: 200 len: 1319 microversion: 2.1 time: 0.155740 Aug 24 03:37:22.789537 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 379/747] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:22 2022] GET /compute/v2.1/servers/1de285c1-cf27-4c89-a56a-9d49322e3f42 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:23.810205 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1fbcfc2c-7002-4ad3-82f2-fbaf3851a589 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:23.810962 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1fbcfc2c-7002-4ad3-82f2-fbaf3851a589 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: 1de285c1-cf27-4c89-a56a-9d49322e3f42] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:23.817673 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1fbcfc2c-7002-4ad3-82f2-fbaf3851a589 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:23.818163 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1fbcfc2c-7002-4ad3-82f2-fbaf3851a589 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:23.818632 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1fbcfc2c-7002-4ad3-82f2-fbaf3851a589 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:23.819336 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1fbcfc2c-7002-4ad3-82f2-fbaf3851a589 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:23.819799 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1fbcfc2c-7002-4ad3-82f2-fbaf3851a589 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:23.820246 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1fbcfc2c-7002-4ad3-82f2-fbaf3851a589 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:23.974652 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1fbcfc2c-7002-4ad3-82f2-fbaf3851a589 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5143313cddbb4f56bf48d84167069c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f494a609f241328d85790280b204b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:23.983103 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1fbcfc2c-7002-4ad3-82f2-fbaf3851a589 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] 10.222.0.81 "GET /compute/v2.1/servers/1de285c1-cf27-4c89-a56a-9d49322e3f42" status: 200 len: 1319 microversion: 2.1 time: 0.176973 Aug 24 03:37:23.983677 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 369/748] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:23 2022] GET /compute/v2.1/servers/1de285c1-cf27-4c89-a56a-9d49322e3f42 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:25.005381 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-dde79e38-f3c4-4431-8c72-a23547bd05bf tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:25.005991 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-dde79e38-f3c4-4431-8c72-a23547bd05bf tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: 1de285c1-cf27-4c89-a56a-9d49322e3f42] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:25.014356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-dde79e38-f3c4-4431-8c72-a23547bd05bf tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:25.014833 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-dde79e38-f3c4-4431-8c72-a23547bd05bf tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:25.015265 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-dde79e38-f3c4-4431-8c72-a23547bd05bf tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:25.015986 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-dde79e38-f3c4-4431-8c72-a23547bd05bf tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:25.016438 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-dde79e38-f3c4-4431-8c72-a23547bd05bf tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:25.016883 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-dde79e38-f3c4-4431-8c72-a23547bd05bf tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:25.143111 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-dde79e38-f3c4-4431-8c72-a23547bd05bf tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5143313cddbb4f56bf48d84167069c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f494a609f241328d85790280b204b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:25.150824 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-dde79e38-f3c4-4431-8c72-a23547bd05bf tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] 10.222.0.81 "GET /compute/v2.1/servers/1de285c1-cf27-4c89-a56a-9d49322e3f42" status: 200 len: 1319 microversion: 2.1 time: 0.149284 Aug 24 03:37:25.151383 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 380/749] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:25 2022] GET /compute/v2.1/servers/1de285c1-cf27-4c89-a56a-9d49322e3f42 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:25.831101 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-7b3ba524-1beb-4557-9f73-9156b4f13ef2 req-b7549f46-191d-41f4-ac8b-aa26f568a2e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1de285c1-cf27-4c89-a56a-9d49322e3f42", "name": "network-vif-plugged", "status": "completed", "tag": "aa70beb4-13fb-47e3-a96f-69b0fe3a7aec"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:25.845280 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-7b3ba524-1beb-4557-9f73-9156b4f13ef2 req-b7549f46-191d-41f4-ac8b-aa26f568a2e5 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:25.845740 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-7b3ba524-1beb-4557-9f73-9156b4f13ef2 req-b7549f46-191d-41f4-ac8b-aa26f568a2e5 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:25.846165 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-7b3ba524-1beb-4557-9f73-9156b4f13ef2 req-b7549f46-191d-41f4-ac8b-aa26f568a2e5 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:25.859794 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-7b3ba524-1beb-4557-9f73-9156b4f13ef2 req-b7549f46-191d-41f4-ac8b-aa26f568a2e5 service nova] Creating event network-vif-plugged:aa70beb4-13fb-47e3-a96f-69b0fe3a7aec for instance 1de285c1-cf27-4c89-a56a-9d49322e3f42 on hv-cinder-85426 Aug 24 03:37:25.866966 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-7b3ba524-1beb-4557-9f73-9156b4f13ef2 req-b7549f46-191d-41f4-ac8b-aa26f568a2e5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039113 Aug 24 03:37:25.867817 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 370/750] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:26.172531 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-c09a625c-f8cb-4e7a-88cb-d71e087c64e4 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:26.173174 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-c09a625c-f8cb-4e7a-88cb-d71e087c64e4 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: 1de285c1-cf27-4c89-a56a-9d49322e3f42] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:26.179541 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c09a625c-f8cb-4e7a-88cb-d71e087c64e4 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:26.180051 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c09a625c-f8cb-4e7a-88cb-d71e087c64e4 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:26.180488 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c09a625c-f8cb-4e7a-88cb-d71e087c64e4 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:26.182664 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c09a625c-f8cb-4e7a-88cb-d71e087c64e4 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:26.183135 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c09a625c-f8cb-4e7a-88cb-d71e087c64e4 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:26.183567 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c09a625c-f8cb-4e7a-88cb-d71e087c64e4 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:26.331199 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-c09a625c-f8cb-4e7a-88cb-d71e087c64e4 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5143313cddbb4f56bf48d84167069c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f494a609f241328d85790280b204b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:26.339601 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-c09a625c-f8cb-4e7a-88cb-d71e087c64e4 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] 10.222.0.81 "GET /compute/v2.1/servers/1de285c1-cf27-4c89-a56a-9d49322e3f42" status: 200 len: 1319 microversion: 2.1 time: 0.170944 Aug 24 03:37:26.340172 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 381/751] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:26 2022] GET /compute/v2.1/servers/1de285c1-cf27-4c89-a56a-9d49322e3f42 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:27.361176 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a06b03ce-aba8-4e92-a687-2abcb1a0b78f tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:27.361873 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a06b03ce-aba8-4e92-a687-2abcb1a0b78f tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: 1de285c1-cf27-4c89-a56a-9d49322e3f42] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:27.367882 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a06b03ce-aba8-4e92-a687-2abcb1a0b78f tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:27.368361 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a06b03ce-aba8-4e92-a687-2abcb1a0b78f tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:27.369423 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a06b03ce-aba8-4e92-a687-2abcb1a0b78f tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:27.370107 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a06b03ce-aba8-4e92-a687-2abcb1a0b78f tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:27.370557 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a06b03ce-aba8-4e92-a687-2abcb1a0b78f tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:27.370979 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a06b03ce-aba8-4e92-a687-2abcb1a0b78f tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:27.504450 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a06b03ce-aba8-4e92-a687-2abcb1a0b78f tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5143313cddbb4f56bf48d84167069c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f494a609f241328d85790280b204b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:27.512056 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a06b03ce-aba8-4e92-a687-2abcb1a0b78f tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] 10.222.0.81 "GET /compute/v2.1/servers/1de285c1-cf27-4c89-a56a-9d49322e3f42" status: 200 len: 1508 microversion: 2.1 time: 0.155713 Aug 24 03:37:27.512606 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 371/752] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:27 2022] GET /compute/v2.1/servers/1de285c1-cf27-4c89-a56a-9d49322e3f42 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:43.765212 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-a62c6182-f9cc-4e80-91dc-6c203699e361 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e23bb49d-7467-410d-9869-cca7fe3aedc1", "device": "/dev/sdb"}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:43.768183 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-a62c6182-f9cc-4e80-91dc-6c203699e361 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: 1de285c1-cf27-4c89-a56a-9d49322e3f42] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:43.770034 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell0:SELECT=2 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:43.770824 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_api:SELECT=11 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:43.771525 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell1:SELECT=13 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:43.779123 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a62c6182-f9cc-4e80-91dc-6c203699e361 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:43.779614 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a62c6182-f9cc-4e80-91dc-6c203699e361 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:43.780051 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a62c6182-f9cc-4e80-91dc-6c203699e361 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:43.780749 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a62c6182-f9cc-4e80-91dc-6c203699e361 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:43.781224 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a62c6182-f9cc-4e80-91dc-6c203699e361 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:43.781646 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a62c6182-f9cc-4e80-91dc-6c203699e361 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:43.972460 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-776cd815-87aa-48dd-b888-bde2a6eedacb tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:43.974622 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-776cd815-87aa-48dd-b888-bde2a6eedacb tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:43.976560 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=2 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:43.977407 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=6 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:43.978164 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=7 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:43.979094 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=64 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:43.986664 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-776cd815-87aa-48dd-b888-bde2a6eedacb tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:43.987343 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-776cd815-87aa-48dd-b888-bde2a6eedacb tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:43.987785 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-776cd815-87aa-48dd-b888-bde2a6eedacb tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:43.988488 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-776cd815-87aa-48dd-b888-bde2a6eedacb tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:43.988987 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-776cd815-87aa-48dd-b888-bde2a6eedacb tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:43.989415 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-776cd815-87aa-48dd-b888-bde2a6eedacb tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:44.020151 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-776cd815-87aa-48dd-b888-bde2a6eedacb tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051696 Aug 24 03:37:44.020727 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 372/753] 10.222.0.81 () {60 vars in 1343 bytes} [Wed Aug 24 03:37:43 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:44.074086 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-a62c6182-f9cc-4e80-91dc-6c203699e361 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] 10.222.0.81 "POST /compute/v2.1/servers/1de285c1-cf27-4c89-a56a-9d49322e3f42/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312249 Aug 24 03:37:44.074893 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 382/754] 10.222.0.81 () {60 vars in 1323 bytes} [Wed Aug 24 03:37:43 2022] POST /compute/v2.1/servers/1de285c1-cf27-4c89-a56a-9d49322e3f42/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:44.086897 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-5e7635c7-7ee8-4992-a997-9700e174239c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:44.087299 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-5e7635c7-7ee8-4992-a997-9700e174239c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:44.096091 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5e7635c7-7ee8-4992-a997-9700e174239c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:44.097073 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5e7635c7-7ee8-4992-a997-9700e174239c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:44.097680 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5e7635c7-7ee8-4992-a997-9700e174239c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:44.098744 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5e7635c7-7ee8-4992-a997-9700e174239c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:44.099206 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5e7635c7-7ee8-4992-a997-9700e174239c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:44.099641 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5e7635c7-7ee8-4992-a997-9700e174239c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:44.125373 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-5e7635c7-7ee8-4992-a997-9700e174239c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Going to try to terminate instance {{(pid=120708) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:37:44.204586 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-5e7635c7-7ee8-4992-a997-9700e174239c tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 204 len: 0 microversion: 2.20 time: 0.121335 Aug 24 03:37:44.205397 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 373/755] 10.222.0.81 () {60 vars in 1280 bytes} [Wed Aug 24 03:37:44 2022] DELETE /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 03:37:44.214827 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-c629b97b-99b2-4b70-9e5c-3349e92eea1f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:44.215531 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-c629b97b-99b2-4b70-9e5c-3349e92eea1f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:44.222815 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c629b97b-99b2-4b70-9e5c-3349e92eea1f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:44.223242 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c629b97b-99b2-4b70-9e5c-3349e92eea1f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:44.223680 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c629b97b-99b2-4b70-9e5c-3349e92eea1f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:44.224375 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c629b97b-99b2-4b70-9e5c-3349e92eea1f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:44.224867 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c629b97b-99b2-4b70-9e5c-3349e92eea1f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:44.225911 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c629b97b-99b2-4b70-9e5c-3349e92eea1f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:44.354512 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-c629b97b-99b2-4b70-9e5c-3349e92eea1f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:44.362664 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-c629b97b-99b2-4b70-9e5c-3349e92eea1f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:44.364148 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-c629b97b-99b2-4b70-9e5c-3349e92eea1f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:44.365327 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-c629b97b-99b2-4b70-9e5c-3349e92eea1f tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1726 microversion: 2.20 time: 0.155124 Aug 24 03:37:44.365885 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 383/756] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:44 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:37:45.389857 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1cfac140-460e-4b46-8ead-8131800b2b50 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:45.390547 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1cfac140-460e-4b46-8ead-8131800b2b50 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:45.396969 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1cfac140-460e-4b46-8ead-8131800b2b50 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:45.397445 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1cfac140-460e-4b46-8ead-8131800b2b50 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:45.397876 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1cfac140-460e-4b46-8ead-8131800b2b50 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:45.398552 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1cfac140-460e-4b46-8ead-8131800b2b50 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:45.399004 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1cfac140-460e-4b46-8ead-8131800b2b50 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:45.399421 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1cfac140-460e-4b46-8ead-8131800b2b50 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:45.533172 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1cfac140-460e-4b46-8ead-8131800b2b50 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:45.541550 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1cfac140-460e-4b46-8ead-8131800b2b50 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:45.543058 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1cfac140-460e-4b46-8ead-8131800b2b50 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:45.544250 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1cfac140-460e-4b46-8ead-8131800b2b50 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1726 microversion: 2.20 time: 0.158633 Aug 24 03:37:45.544851 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 374/757] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:45 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:46.567243 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-ce5c0af5-7644-4c8d-86c9-5ba49315ff92 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:46.568398 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-ce5c0af5-7644-4c8d-86c9-5ba49315ff92 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:46.575610 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ce5c0af5-7644-4c8d-86c9-5ba49315ff92 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:46.576097 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ce5c0af5-7644-4c8d-86c9-5ba49315ff92 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:46.576535 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ce5c0af5-7644-4c8d-86c9-5ba49315ff92 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:46.577267 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ce5c0af5-7644-4c8d-86c9-5ba49315ff92 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:46.577720 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ce5c0af5-7644-4c8d-86c9-5ba49315ff92 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:46.578148 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ce5c0af5-7644-4c8d-86c9-5ba49315ff92 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:46.641790 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-ce5c0af5-7644-4c8d-86c9-5ba49315ff92 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:46.650090 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-ce5c0af5-7644-4c8d-86c9-5ba49315ff92 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:46.651857 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-ce5c0af5-7644-4c8d-86c9-5ba49315ff92 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1af20de2433c44ff8fb1f16290404c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5da9e76bed44f3d90144e4fbff2cb1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:46.653137 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-ce5c0af5-7644-4c8d-86c9-5ba49315ff92 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 200 len: 1658 microversion: 2.20 time: 0.089863 Aug 24 03:37:46.653780 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 384/758] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:46 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 1658 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:37:46.734420 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-f9987891-5158-4314-b894-9754a4971814 req-7968e702-a7b9-4bb8-9690-ad6fc610ef22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4", "name": "network-vif-deleted", "tag": "c49bffe3-b213-40d0-a914-6759e188a044"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:46.746561 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-f9987891-5158-4314-b894-9754a4971814 req-7968e702-a7b9-4bb8-9690-ad6fc610ef22 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:46.747721 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-f9987891-5158-4314-b894-9754a4971814 req-7968e702-a7b9-4bb8-9690-ad6fc610ef22 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:46.748355 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-f9987891-5158-4314-b894-9754a4971814 req-7968e702-a7b9-4bb8-9690-ad6fc610ef22 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:46.763685 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-f9987891-5158-4314-b894-9754a4971814 req-7968e702-a7b9-4bb8-9690-ad6fc610ef22 service nova] Creating event network-vif-deleted:c49bffe3-b213-40d0-a914-6759e188a044 for instance a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 on hv-cinder-85426 Aug 24 03:37:46.770174 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-f9987891-5158-4314-b894-9754a4971814 req-7968e702-a7b9-4bb8-9690-ad6fc610ef22 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039785 Aug 24 03:37:46.770770 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 375/759] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:37:47.675722 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-1b157638-fc63-4ebe-970c-c45de65ed2fd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:47.676455 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-1b157638-fc63-4ebe-970c-c45de65ed2fd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:47.683527 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1b157638-fc63-4ebe-970c-c45de65ed2fd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:47.684010 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1b157638-fc63-4ebe-970c-c45de65ed2fd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:47.684456 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1b157638-fc63-4ebe-970c-c45de65ed2fd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:47.685186 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1b157638-fc63-4ebe-970c-c45de65ed2fd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:47.685642 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1b157638-fc63-4ebe-970c-c45de65ed2fd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:47.686073 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1b157638-fc63-4ebe-970c-c45de65ed2fd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:47.700212 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.wsgi [None req-1b157638-fc63-4ebe-970c-c45de65ed2fd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] HTTP exception thrown: Instance a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 could not be found. Aug 24 03:37:47.701834 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-1b157638-fc63-4ebe-970c-c45de65ed2fd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Request method failure captured: Aug 24 03:37:47.701834 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: request: GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 HTTP/1.1 Aug 24 03:37:47.701834 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept: application/json Aug 24 03:37:47.701834 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept-Encoding: identity Aug 24 03:37:47.701834 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Connection: close Aug 24 03:37:47.701834 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Length: 0 Aug 24 03:37:47.701834 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Type: application/json Aug 24 03:37:47.701834 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Host: 10.222.0.81 Aug 24 03:37:47.701834 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Openstack-System-Scope: None Aug 24 03:37:47.701834 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:47.701834 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Auth-Token: gAAAAABjBZuU5Ur16JA0Q33qyxvYzcFhUDzzzqyl8J3qPAx9L5VQ_xCO9RNsAHrl_suhajqqZOhJFrFAlz0L2fhPtzn3BHE_P6zVIMdZwTDQWkyrUNMoknDnQrZUczvh8w364-XN8VgV8x_z6gHGZYF0jODp-A2xaDd9dGqTknsxFOz7yOgL_Pg Aug 24 03:37:47.701834 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Id: None Aug 24 03:37:47.701834 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Name: None Aug 24 03:37:47.701834 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Identity-Status: Confirmed Aug 24 03:37:47.701834 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Is-Admin-Project: True Aug 24 03:37:47.701834 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 03:37:47.701834 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Id: default Aug 24 03:37:47.701834 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Name: Default Aug 24 03:37:47.701834 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Id: b5da9e76bed44f3d90144e4fbff2cb1c Aug 24 03:37:47.701834 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1702847769 Aug 24 03:37:47.701834 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Role: reader,member Aug 24 03:37:47.701834 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Roles: reader,member Aug 24 03:37:47.703520 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b5da9e76bed44f3d90144e4fbff2cb1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_b5da9e76bed44f3d90144e4fbff2cb1c", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b5da9e76bed44f3d90144e4fbff2cb1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/b5da9e76bed44f3d90144e4fbff2cb1c"}]}] Aug 24 03:37:47.703520 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1702847769 Aug 24 03:37:47.703520 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Id: b5da9e76bed44f3d90144e4fbff2cb1c Aug 24 03:37:47.703520 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1702847769 Aug 24 03:37:47.703520 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User: tempest-AttachVolumeShelveTestJSON-1702847769-project Aug 24 03:37:47.703520 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Id: default Aug 24 03:37:47.703520 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Name: Default Aug 24 03:37:47.703520 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Id: 1af20de2433c44ff8fb1f16290404c21 Aug 24 03:37:47.703520 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1702847769-project Aug 24 03:37:47.703520 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: method: > Aug 24 03:37:47.703520 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: exception: Instance a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 could not be found. Aug 24 03:37:47.703520 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: action_args: {'id': 'a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4'} Aug 24 03:37:47.704380 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:47.704380 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:47.704380 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:37:47.704380 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:37:47.704380 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:37:47.704380 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:37:47.704380 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:37:47.704380 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:37:47.704380 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:37:47.704380 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:37:47.704380 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 could not be found. Aug 24 03:37:47.704380 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:37:47.704380 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:47.704380 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:37:47.704380 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:47.704380 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:47.704380 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:47.704380 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:47.704380 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:47.704380 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:47.705699 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:47.705699 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:37:47.705699 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:37:47.705699 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:37:47.705699 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:37:47.705699 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:37:47.705699 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:37:47.705699 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 could not be found. Aug 24 03:37:47.705699 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:37:47.705699 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:47.705699 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:37:47.705699 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:47.705699 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:47.705699 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:47.705699 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:37:47.705699 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:37:47.705699 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 could not be found. Aug 24 03:37:47.705699 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:37:47.707006 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-1b157638-fc63-4ebe-970c-c45de65ed2fd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Returning 404 to user: Instance a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 could not be found. {{(pid=120709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:47.707006 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-1b157638-fc63-4ebe-970c-c45de65ed2fd tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 404 len: 111 microversion: 2.20 time: 0.031471 Aug 24 03:37:47.707006 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 385/760] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:47 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:37:47.712681 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-38a585e6-fcfe-4e13-b236-28dbbce7c58e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '.version_select at 0x7f942f17c9d0>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:47.733084 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-38a585e6-fcfe-4e13-b236-28dbbce7c58e tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1367660773" status: 204 len: 0 microversion: 2.20 time: 0.024372 Aug 24 03:37:47.733773 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 376/761] 10.222.0.81 () {60 vars in 1262 bytes} [Wed Aug 24 03:37:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1367660773 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 03:37:49.490161 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-1a87cbbc-530a-4050-bc5e-0a31692782d5 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:49.490673 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-1a87cbbc-530a-4050-bc5e-0a31692782d5 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:49.497635 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1a87cbbc-530a-4050-bc5e-0a31692782d5 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:49.498116 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1a87cbbc-530a-4050-bc5e-0a31692782d5 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:49.498550 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1a87cbbc-530a-4050-bc5e-0a31692782d5 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:49.499351 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1a87cbbc-530a-4050-bc5e-0a31692782d5 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:49.499805 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1a87cbbc-530a-4050-bc5e-0a31692782d5 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:49.500228 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1a87cbbc-530a-4050-bc5e-0a31692782d5 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:49.513952 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.wsgi [None req-1a87cbbc-530a-4050-bc5e-0a31692782d5 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] HTTP exception thrown: Instance a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 could not be found. Aug 24 03:37:49.515455 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-1a87cbbc-530a-4050-bc5e-0a31692782d5 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Request method failure captured: Aug 24 03:37:49.515455 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: request: DELETE /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 HTTP/1.1 Aug 24 03:37:49.515455 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept: application/json Aug 24 03:37:49.515455 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept-Encoding: identity Aug 24 03:37:49.515455 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Connection: close Aug 24 03:37:49.515455 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Length: 0 Aug 24 03:37:49.515455 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Type: application/json Aug 24 03:37:49.515455 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Host: 10.222.0.81 Aug 24 03:37:49.515455 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Openstack-System-Scope: None Aug 24 03:37:49.515455 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:49.515455 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Auth-Token: gAAAAABjBZuU5Ur16JA0Q33qyxvYzcFhUDzzzqyl8J3qPAx9L5VQ_xCO9RNsAHrl_suhajqqZOhJFrFAlz0L2fhPtzn3BHE_P6zVIMdZwTDQWkyrUNMoknDnQrZUczvh8w364-XN8VgV8x_z6gHGZYF0jODp-A2xaDd9dGqTknsxFOz7yOgL_Pg Aug 24 03:37:49.515455 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Id: None Aug 24 03:37:49.515455 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Name: None Aug 24 03:37:49.515455 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Identity-Status: Confirmed Aug 24 03:37:49.515455 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Is-Admin-Project: True Aug 24 03:37:49.515455 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 03:37:49.515455 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Id: default Aug 24 03:37:49.515455 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Name: Default Aug 24 03:37:49.515455 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Id: b5da9e76bed44f3d90144e4fbff2cb1c Aug 24 03:37:49.515455 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1702847769 Aug 24 03:37:49.515455 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Role: reader,member Aug 24 03:37:49.515455 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Roles: reader,member Aug 24 03:37:49.517149 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b5da9e76bed44f3d90144e4fbff2cb1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_b5da9e76bed44f3d90144e4fbff2cb1c", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b5da9e76bed44f3d90144e4fbff2cb1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/b5da9e76bed44f3d90144e4fbff2cb1c"}]}] Aug 24 03:37:49.517149 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1702847769 Aug 24 03:37:49.517149 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Id: b5da9e76bed44f3d90144e4fbff2cb1c Aug 24 03:37:49.517149 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1702847769 Aug 24 03:37:49.517149 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User: tempest-AttachVolumeShelveTestJSON-1702847769-project Aug 24 03:37:49.517149 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Id: default Aug 24 03:37:49.517149 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Name: Default Aug 24 03:37:49.517149 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Id: 1af20de2433c44ff8fb1f16290404c21 Aug 24 03:37:49.517149 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1702847769-project Aug 24 03:37:49.517149 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: method: > Aug 24 03:37:49.517149 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: exception: Instance a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 could not be found. Aug 24 03:37:49.517149 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: action_args: {'id': 'a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4'} Aug 24 03:37:49.518137 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:49.518137 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:49.518137 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:37:49.518137 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:37:49.518137 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:37:49.518137 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:37:49.518137 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:37:49.518137 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:37:49.518137 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:37:49.518137 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:37:49.518137 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 could not be found. Aug 24 03:37:49.518137 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:37:49.518137 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:49.518137 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:37:49.518137 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:49.518137 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:49.518137 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:49.518137 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:49.518137 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:49.518137 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:49.519585 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:49.519585 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:37:49.519585 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:37:49.519585 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:37:49.519585 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:37:49.519585 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:37:49.519585 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:37:49.519585 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:37:49.519585 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:37:49.519585 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 could not be found. Aug 24 03:37:49.519585 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:37:49.519585 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:49.519585 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:37:49.519585 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:49.519585 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:49.519585 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:49.519585 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:37:49.519585 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:37:49.519585 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 could not be found. Aug 24 03:37:49.519585 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:37:49.521120 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-1a87cbbc-530a-4050-bc5e-0a31692782d5 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Returning 404 to user: Instance a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 could not be found. {{(pid=120709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:49.521120 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-1a87cbbc-530a-4050-bc5e-0a31692782d5 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 404 len: 111 microversion: 2.20 time: 0.030738 Aug 24 03:37:49.521120 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 386/762] 10.222.0.81 () {60 vars in 1280 bytes} [Wed Aug 24 03:37:49 2022] DELETE /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:37:49.525943 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-e6df5ff3-dbb1-4243-a340-1c512d9cb2b8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:49.526669 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-e6df5ff3-dbb1-4243-a340-1c512d9cb2b8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:49.532724 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e6df5ff3-dbb1-4243-a340-1c512d9cb2b8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:49.533270 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e6df5ff3-dbb1-4243-a340-1c512d9cb2b8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:49.533716 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e6df5ff3-dbb1-4243-a340-1c512d9cb2b8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:49.534404 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e6df5ff3-dbb1-4243-a340-1c512d9cb2b8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:49.534860 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e6df5ff3-dbb1-4243-a340-1c512d9cb2b8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:49.535291 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e6df5ff3-dbb1-4243-a340-1c512d9cb2b8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:49.548634 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-e6df5ff3-dbb1-4243-a340-1c512d9cb2b8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] HTTP exception thrown: Instance a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 could not be found. Aug 24 03:37:49.550280 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-e6df5ff3-dbb1-4243-a340-1c512d9cb2b8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Request method failure captured: Aug 24 03:37:49.550280 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 HTTP/1.1 Aug 24 03:37:49.550280 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 24 03:37:49.550280 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 24 03:37:49.550280 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Connection: close Aug 24 03:37:49.550280 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 24 03:37:49.550280 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 24 03:37:49.550280 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Host: 10.222.0.81 Aug 24 03:37:49.550280 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 24 03:37:49.550280 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:49.550280 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjBZuU5Ur16JA0Q33qyxvYzcFhUDzzzqyl8J3qPAx9L5VQ_xCO9RNsAHrl_suhajqqZOhJFrFAlz0L2fhPtzn3BHE_P6zVIMdZwTDQWkyrUNMoknDnQrZUczvh8w364-XN8VgV8x_z6gHGZYF0jODp-A2xaDd9dGqTknsxFOz7yOgL_Pg Aug 24 03:37:49.550280 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 24 03:37:49.550280 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 24 03:37:49.550280 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 24 03:37:49.550280 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 24 03:37:49.550280 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 03:37:49.550280 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 24 03:37:49.550280 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 24 03:37:49.550280 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Id: b5da9e76bed44f3d90144e4fbff2cb1c Aug 24 03:37:49.550280 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1702847769 Aug 24 03:37:49.550280 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 24 03:37:49.550280 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 24 03:37:49.551895 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b5da9e76bed44f3d90144e4fbff2cb1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_b5da9e76bed44f3d90144e4fbff2cb1c", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b5da9e76bed44f3d90144e4fbff2cb1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/b5da9e76bed44f3d90144e4fbff2cb1c"}]}] Aug 24 03:37:49.551895 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1702847769 Aug 24 03:37:49.551895 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Id: b5da9e76bed44f3d90144e4fbff2cb1c Aug 24 03:37:49.551895 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1702847769 Aug 24 03:37:49.551895 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User: tempest-AttachVolumeShelveTestJSON-1702847769-project Aug 24 03:37:49.551895 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 24 03:37:49.551895 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 24 03:37:49.551895 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Id: 1af20de2433c44ff8fb1f16290404c21 Aug 24 03:37:49.551895 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1702847769-project Aug 24 03:37:49.551895 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: method: > Aug 24 03:37:49.551895 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: exception: Instance a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 could not be found. Aug 24 03:37:49.551895 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: action_args: {'id': 'a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4'} Aug 24 03:37:49.552807 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:49.552807 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:49.552807 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:37:49.552807 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:37:49.552807 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:37:49.552807 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:37:49.552807 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:37:49.552807 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:37:49.552807 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:37:49.552807 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:37:49.552807 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 could not be found. Aug 24 03:37:49.552807 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:37:49.552807 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:49.552807 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:37:49.552807 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:49.552807 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:49.552807 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:49.552807 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:49.552807 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:49.552807 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:49.554390 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:49.554390 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:37:49.554390 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:37:49.554390 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:37:49.554390 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:37:49.554390 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:37:49.554390 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:37:49.554390 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 could not be found. Aug 24 03:37:49.554390 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:37:49.554390 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:49.554390 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:37:49.554390 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:49.554390 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:49.554390 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:49.554390 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:37:49.554390 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:37:49.554390 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 could not be found. Aug 24 03:37:49.554390 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:37:49.555693 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-e6df5ff3-dbb1-4243-a340-1c512d9cb2b8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Returning 404 to user: Instance a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:49.555693 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-e6df5ff3-dbb1-4243-a340-1c512d9cb2b8 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4" status: 404 len: 111 microversion: 2.20 time: 0.030190 Aug 24 03:37:49.555693 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 377/763] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:49 2022] GET /compute/v2.1/servers/a4bbdd27-ab6f-48a9-bf31-b2ae9e4881b4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:37:50.694087 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-d552a91c-3d2b-415c-b58f-e48a5a6f7ebe tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:50.694596 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-d552a91c-3d2b-415c-b58f-e48a5a6f7ebe tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:50.701292 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d552a91c-3d2b-415c-b58f-e48a5a6f7ebe tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:50.701718 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d552a91c-3d2b-415c-b58f-e48a5a6f7ebe tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:50.702158 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d552a91c-3d2b-415c-b58f-e48a5a6f7ebe tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:50.702851 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d552a91c-3d2b-415c-b58f-e48a5a6f7ebe tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:50.703305 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d552a91c-3d2b-415c-b58f-e48a5a6f7ebe tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:50.703731 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d552a91c-3d2b-415c-b58f-e48a5a6f7ebe tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:50.717755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.wsgi [None req-d552a91c-3d2b-415c-b58f-e48a5a6f7ebe tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] HTTP exception thrown: Instance 4a89effc-2ad4-414e-bca5-d503b48fb040 could not be found. Aug 24 03:37:50.719295 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-d552a91c-3d2b-415c-b58f-e48a5a6f7ebe tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Request method failure captured: Aug 24 03:37:50.719295 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: request: DELETE /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 HTTP/1.1 Aug 24 03:37:50.719295 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept: application/json Aug 24 03:37:50.719295 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept-Encoding: identity Aug 24 03:37:50.719295 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Connection: close Aug 24 03:37:50.719295 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Length: 0 Aug 24 03:37:50.719295 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Type: application/json Aug 24 03:37:50.719295 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Host: 10.222.0.81 Aug 24 03:37:50.719295 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Openstack-System-Scope: None Aug 24 03:37:50.719295 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:50.719295 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Auth-Token: gAAAAABjBZuU5Ur16JA0Q33qyxvYzcFhUDzzzqyl8J3qPAx9L5VQ_xCO9RNsAHrl_suhajqqZOhJFrFAlz0L2fhPtzn3BHE_P6zVIMdZwTDQWkyrUNMoknDnQrZUczvh8w364-XN8VgV8x_z6gHGZYF0jODp-A2xaDd9dGqTknsxFOz7yOgL_Pg Aug 24 03:37:50.719295 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Id: None Aug 24 03:37:50.719295 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Name: None Aug 24 03:37:50.719295 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Identity-Status: Confirmed Aug 24 03:37:50.719295 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Is-Admin-Project: True Aug 24 03:37:50.719295 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 03:37:50.719295 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Id: default Aug 24 03:37:50.719295 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Name: Default Aug 24 03:37:50.719295 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Id: b5da9e76bed44f3d90144e4fbff2cb1c Aug 24 03:37:50.719295 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1702847769 Aug 24 03:37:50.719295 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Role: reader,member Aug 24 03:37:50.719295 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Roles: reader,member Aug 24 03:37:50.720923 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b5da9e76bed44f3d90144e4fbff2cb1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_b5da9e76bed44f3d90144e4fbff2cb1c", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b5da9e76bed44f3d90144e4fbff2cb1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/b5da9e76bed44f3d90144e4fbff2cb1c"}]}] Aug 24 03:37:50.720923 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1702847769 Aug 24 03:37:50.720923 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Id: b5da9e76bed44f3d90144e4fbff2cb1c Aug 24 03:37:50.720923 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1702847769 Aug 24 03:37:50.720923 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User: tempest-AttachVolumeShelveTestJSON-1702847769-project Aug 24 03:37:50.720923 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Id: default Aug 24 03:37:50.720923 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Name: Default Aug 24 03:37:50.720923 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Id: 1af20de2433c44ff8fb1f16290404c21 Aug 24 03:37:50.720923 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1702847769-project Aug 24 03:37:50.720923 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: method: > Aug 24 03:37:50.720923 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: exception: Instance 4a89effc-2ad4-414e-bca5-d503b48fb040 could not be found. Aug 24 03:37:50.720923 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: action_args: {'id': '4a89effc-2ad4-414e-bca5-d503b48fb040'} Aug 24 03:37:50.721836 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:50.721836 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:50.721836 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:37:50.721836 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:37:50.721836 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:37:50.721836 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:37:50.721836 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:37:50.721836 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:37:50.721836 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:37:50.721836 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:37:50.721836 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a89effc-2ad4-414e-bca5-d503b48fb040 could not be found. Aug 24 03:37:50.721836 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:37:50.721836 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:50.721836 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:37:50.721836 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:50.721836 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:50.721836 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:50.721836 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:50.721836 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:50.721836 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:50.723231 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:50.723231 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:37:50.723231 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:37:50.723231 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:37:50.723231 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:37:50.723231 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:37:50.723231 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:37:50.723231 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:37:50.723231 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:37:50.723231 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a89effc-2ad4-414e-bca5-d503b48fb040 could not be found. Aug 24 03:37:50.723231 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:37:50.723231 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:50.723231 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:37:50.723231 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:50.723231 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:50.723231 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:50.723231 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:37:50.723231 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:37:50.723231 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a89effc-2ad4-414e-bca5-d503b48fb040 could not be found. Aug 24 03:37:50.723231 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:37:50.724634 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-d552a91c-3d2b-415c-b58f-e48a5a6f7ebe tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Returning 404 to user: Instance 4a89effc-2ad4-414e-bca5-d503b48fb040 could not be found. {{(pid=120709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:50.724634 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-d552a91c-3d2b-415c-b58f-e48a5a6f7ebe tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "DELETE /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 404 len: 111 microversion: 2.20 time: 0.030494 Aug 24 03:37:50.724634 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 387/764] 10.222.0.81 () {60 vars in 1280 bytes} [Wed Aug 24 03:37:50 2022] DELETE /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:37:50.729780 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-33b955ec-5494-4dd9-b4e5-4500cd0c98a4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:50.730414 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-33b955ec-5494-4dd9-b4e5-4500cd0c98a4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] [instance: 4a89effc-2ad4-414e-bca5-d503b48fb040] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:50.736737 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-33b955ec-5494-4dd9-b4e5-4500cd0c98a4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:50.737293 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-33b955ec-5494-4dd9-b4e5-4500cd0c98a4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:50.737734 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-33b955ec-5494-4dd9-b4e5-4500cd0c98a4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:50.738429 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-33b955ec-5494-4dd9-b4e5-4500cd0c98a4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:50.738927 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-33b955ec-5494-4dd9-b4e5-4500cd0c98a4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:50.739387 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-33b955ec-5494-4dd9-b4e5-4500cd0c98a4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:50.753568 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-33b955ec-5494-4dd9-b4e5-4500cd0c98a4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] HTTP exception thrown: Instance 4a89effc-2ad4-414e-bca5-d503b48fb040 could not be found. Aug 24 03:37:50.755086 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-33b955ec-5494-4dd9-b4e5-4500cd0c98a4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Request method failure captured: Aug 24 03:37:50.755086 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 HTTP/1.1 Aug 24 03:37:50.755086 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 24 03:37:50.755086 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 24 03:37:50.755086 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Connection: close Aug 24 03:37:50.755086 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 24 03:37:50.755086 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 24 03:37:50.755086 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Host: 10.222.0.81 Aug 24 03:37:50.755086 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 24 03:37:50.755086 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.11 Aug 24 03:37:50.755086 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjBZuU5Ur16JA0Q33qyxvYzcFhUDzzzqyl8J3qPAx9L5VQ_xCO9RNsAHrl_suhajqqZOhJFrFAlz0L2fhPtzn3BHE_P6zVIMdZwTDQWkyrUNMoknDnQrZUczvh8w364-XN8VgV8x_z6gHGZYF0jODp-A2xaDd9dGqTknsxFOz7yOgL_Pg Aug 24 03:37:50.755086 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 24 03:37:50.755086 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 24 03:37:50.755086 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 24 03:37:50.755086 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 24 03:37:50.755086 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 03:37:50.755086 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 24 03:37:50.755086 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 24 03:37:50.755086 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Id: b5da9e76bed44f3d90144e4fbff2cb1c Aug 24 03:37:50.755086 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1702847769 Aug 24 03:37:50.755086 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 24 03:37:50.755086 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 24 03:37:50.756716 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b5da9e76bed44f3d90144e4fbff2cb1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_b5da9e76bed44f3d90144e4fbff2cb1c", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/b5da9e76bed44f3d90144e4fbff2cb1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/b5da9e76bed44f3d90144e4fbff2cb1c"}]}] Aug 24 03:37:50.756716 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1702847769 Aug 24 03:37:50.756716 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Id: b5da9e76bed44f3d90144e4fbff2cb1c Aug 24 03:37:50.756716 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1702847769 Aug 24 03:37:50.756716 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User: tempest-AttachVolumeShelveTestJSON-1702847769-project Aug 24 03:37:50.756716 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 24 03:37:50.756716 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 24 03:37:50.756716 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Id: 1af20de2433c44ff8fb1f16290404c21 Aug 24 03:37:50.756716 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1702847769-project Aug 24 03:37:50.756716 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: method: > Aug 24 03:37:50.756716 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: exception: Instance 4a89effc-2ad4-414e-bca5-d503b48fb040 could not be found. Aug 24 03:37:50.756716 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: action_args: {'id': '4a89effc-2ad4-414e-bca5-d503b48fb040'} Aug 24 03:37:50.757515 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:37:50.757515 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:50.757515 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:37:50.757515 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:37:50.757515 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:37:50.757515 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:37:50.757515 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:37:50.757515 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:37:50.757515 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:37:50.757515 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:37:50.757515 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a89effc-2ad4-414e-bca5-d503b48fb040 could not be found. Aug 24 03:37:50.757515 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:37:50.757515 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:50.757515 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:37:50.757515 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:50.757515 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:50.757515 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:50.757515 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:37:50.757515 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:37:50.757515 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:37:50.758684 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:37:50.758684 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:37:50.758684 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:37:50.758684 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:37:50.758684 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:37:50.758684 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:37:50.758684 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:37:50.758684 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a89effc-2ad4-414e-bca5-d503b48fb040 could not be found. Aug 24 03:37:50.758684 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:37:50.758684 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:37:50.758684 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:37:50.758684 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:37:50.758684 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:37:50.758684 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:37:50.758684 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:37:50.758684 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:37:50.758684 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a89effc-2ad4-414e-bca5-d503b48fb040 could not be found. Aug 24 03:37:50.758684 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:37:50.759761 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-33b955ec-5494-4dd9-b4e5-4500cd0c98a4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] Returning 404 to user: Instance 4a89effc-2ad4-414e-bca5-d503b48fb040 could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:37:50.759761 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-33b955ec-5494-4dd9-b4e5-4500cd0c98a4 tempest-AttachVolumeShelveTestJSON-1702847769 tempest-AttachVolumeShelveTestJSON-1702847769-project] 10.222.0.81 "GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040" status: 404 len: 111 microversion: 2.20 time: 0.031090 Aug 24 03:37:50.759761 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 378/765] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Aug 24 03:37:50 2022] GET /compute/v2.1/servers/4a89effc-2ad4-414e-bca5-d503b48fb040 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 03:37:59.445857 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-5cf0fa08-42c7-4dd1-9b59-3348d7ec736c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Action: 'create', calling method: .version_select at 0x7f942f47daf0>, body: {"keypair": {"name": "tempest-keypair-1952984710", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJ0izpgimM4qzKhGQfRf2FG0ssSOocMT9OCitFuYKpcSS3Loy1uCACjyZtTio2iLWYLh7bVRN74/ltRO5cFxkWQjVB1jb8tl8wHo8qZ8obUewl8a2PFKjU+jaktc8N0SQ=="}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:59.461914 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.quota [None req-5cf0fa08-42c7-4dd1-9b59-3348d7ec736c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Getting quotas for project 4b05b1de2f064ba29a6d0f7f4c8b2a01. Resources: {'key_pairs'} {{(pid=120709) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:37:59.467310 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.quota [None req-5cf0fa08-42c7-4dd1-9b59-3348d7ec736c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Getting quotas for user e9fa457d74c644a3ad740da44576a12f and project 4b05b1de2f064ba29a6d0f7f4c8b2a01. Resources: {'key_pairs'} {{(pid=120709) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:37:59.491782 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-5cf0fa08-42c7-4dd1-9b59-3348d7ec736c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.196282 Aug 24 03:37:59.492083 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 388/766] 10.222.0.81 () {60 vars in 1159 bytes} [Wed Aug 24 03:37:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:00.863735 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-19119a27-1345-4b10-8fb7-267321fba24d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1301008127", "imageRef": "b7a40f0c-20c2-44cd-8b0e-f6e73a007d3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f7160365-682d-4059-86b5-916b47b99501"}], "security_groups": [{"name": "tempest-securitygroup--929998751"}], "key_name": "tempest-keypair-1952984710", "user_data": "}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:00.872939 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:00.873599 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:00.979715 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.network.neutron [None req-19119a27-1345-4b10-8fb7-267321fba24d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] validate_networks() for [('f7160365-682d-4059-86b5-916b47b99501', None, None, None, None, None)] {{(pid=120708) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:38:01.353095 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-19119a27-1345-4b10-8fb7-267321fba24d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Flavor limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:38:01.353751 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-19119a27-1345-4b10-8fb7-267321fba24d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Image limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:38:01.354354 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-19119a27-1345-4b10-8fb7-267321fba24d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Flavor pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:38:01.354777 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-19119a27-1345-4b10-8fb7-267321fba24d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Image pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:38:01.355199 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-19119a27-1345-4b10-8fb7-267321fba24d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:38:01.364138 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-19119a27-1345-4b10-8fb7-267321fba24d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:01.364626 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-19119a27-1345-4b10-8fb7-267321fba24d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:01.365098 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-19119a27-1345-4b10-8fb7-267321fba24d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:01.365841 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-19119a27-1345-4b10-8fb7-267321fba24d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:01.366298 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-19119a27-1345-4b10-8fb7-267321fba24d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:01.366726 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-19119a27-1345-4b10-8fb7-267321fba24d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:01.383331 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-19119a27-1345-4b10-8fb7-267321fba24d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Getting quotas for project 4b05b1de2f064ba29a6d0f7f4c8b2a01. Resources: {'ram', 'instances', 'cores'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:38:01.388955 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-19119a27-1345-4b10-8fb7-267321fba24d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Getting quotas for user e9fa457d74c644a3ad740da44576a12f and project 4b05b1de2f064ba29a6d0f7f4c8b2a01. Resources: {'ram', 'instances', 'cores'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:38:01.400032 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-19119a27-1345-4b10-8fb7-267321fba24d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Going to run 1 instances... {{(pid=120708) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:38:01.403022 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-19119a27-1345-4b10-8fb7-267321fba24d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 3a493863-6fda-4311-8271-48f093698726] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b7a40f0c-20c2-44cd-8b0e-f6e73a007d3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120708) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:38:01.453380 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-19119a27-1345-4b10-8fb7-267321fba24d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.593718 Aug 24 03:38:01.454377 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 379/767] 10.222.0.81 () {60 vars in 1147 bytes} [Wed Aug 24 03:38:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:38:01.462660 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:01.469109 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-9eeecf4e-1a88-4d1c-bf05-3c49afe6f5f6 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:01.470124 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-9eeecf4e-1a88-4d1c-bf05-3c49afe6f5f6 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 3a493863-6fda-4311-8271-48f093698726] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:01.535430 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-9eeecf4e-1a88-4d1c-bf05-3c49afe6f5f6 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:01.545420 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-9eeecf4e-1a88-4d1c-bf05-3c49afe6f5f6 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726" status: 200 len: 1242 microversion: 2.1 time: 0.084145 Aug 24 03:38:01.546550 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 389/768] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:01 2022] GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:02.566885 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-e888c186-add9-4796-9f93-a538e6c05bb3 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:02.567491 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-e888c186-add9-4796-9f93-a538e6c05bb3 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 3a493863-6fda-4311-8271-48f093698726] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:02.575484 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e888c186-add9-4796-9f93-a538e6c05bb3 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:02.575968 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e888c186-add9-4796-9f93-a538e6c05bb3 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:02.576404 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e888c186-add9-4796-9f93-a538e6c05bb3 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:02.577128 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e888c186-add9-4796-9f93-a538e6c05bb3 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:02.577582 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e888c186-add9-4796-9f93-a538e6c05bb3 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:02.578008 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e888c186-add9-4796-9f93-a538e6c05bb3 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:02.646678 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-e888c186-add9-4796-9f93-a538e6c05bb3 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:02.655183 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-e888c186-add9-4796-9f93-a538e6c05bb3 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726" status: 200 len: 1246 microversion: 2.1 time: 0.092697 Aug 24 03:38:02.656072 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 380/769] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:02 2022] GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726 => generated 1246 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:03.676151 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-2015ded2-80e5-4707-990f-acbbefdf8072 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:03.676790 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-2015ded2-80e5-4707-990f-acbbefdf8072 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 3a493863-6fda-4311-8271-48f093698726] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:03.683944 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2015ded2-80e5-4707-990f-acbbefdf8072 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:03.684439 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2015ded2-80e5-4707-990f-acbbefdf8072 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:03.684910 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2015ded2-80e5-4707-990f-acbbefdf8072 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:03.685618 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2015ded2-80e5-4707-990f-acbbefdf8072 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:03.686210 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2015ded2-80e5-4707-990f-acbbefdf8072 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:03.686705 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2015ded2-80e5-4707-990f-acbbefdf8072 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:03.752074 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-2015ded2-80e5-4707-990f-acbbefdf8072 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:03.760255 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-2015ded2-80e5-4707-990f-acbbefdf8072 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726" status: 200 len: 1294 microversion: 2.1 time: 0.087290 Aug 24 03:38:03.761492 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 390/770] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:03 2022] GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726 => generated 1294 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:04.782618 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c680f78a-953e-4c05-a10d-849e69310258 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:04.783988 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c680f78a-953e-4c05-a10d-849e69310258 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 3a493863-6fda-4311-8271-48f093698726] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:04.790903 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c680f78a-953e-4c05-a10d-849e69310258 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:04.791770 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c680f78a-953e-4c05-a10d-849e69310258 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:04.792406 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c680f78a-953e-4c05-a10d-849e69310258 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:04.793337 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c680f78a-953e-4c05-a10d-849e69310258 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:04.794120 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c680f78a-953e-4c05-a10d-849e69310258 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:04.794718 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c680f78a-953e-4c05-a10d-849e69310258 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:04.949459 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c680f78a-953e-4c05-a10d-849e69310258 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:04.958213 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c680f78a-953e-4c05-a10d-849e69310258 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726" status: 200 len: 1367 microversion: 2.1 time: 0.179333 Aug 24 03:38:04.958890 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 381/771] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:04 2022] GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:05.430076 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-1567ed51-8521-4b23-a997-b5c76ef39ee0 req-b37bda77-922d-4e20-84f3-ce725134809a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a493863-6fda-4311-8271-48f093698726", "tag": "a3e235e1-9925-4bd2-ad87-9f5d93265022"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:05.441182 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-1567ed51-8521-4b23-a997-b5c76ef39ee0 req-b37bda77-922d-4e20-84f3-ce725134809a service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:05.441837 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-1567ed51-8521-4b23-a997-b5c76ef39ee0 req-b37bda77-922d-4e20-84f3-ce725134809a service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:05.442353 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-1567ed51-8521-4b23-a997-b5c76ef39ee0 req-b37bda77-922d-4e20-84f3-ce725134809a service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:05.454006 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-1567ed51-8521-4b23-a997-b5c76ef39ee0 req-b37bda77-922d-4e20-84f3-ce725134809a service nova] Creating event network-changed:a3e235e1-9925-4bd2-ad87-9f5d93265022 for instance 3a493863-6fda-4311-8271-48f093698726 on hv-cinder-85426 Aug 24 03:38:05.458799 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-1567ed51-8521-4b23-a997-b5c76ef39ee0 req-b37bda77-922d-4e20-84f3-ce725134809a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032483 Aug 24 03:38:05.459391 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 391/772] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:05.979385 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-06d97fb7-344a-4ec5-9a2f-7fcfa4e8daf8 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:05.980036 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-06d97fb7-344a-4ec5-9a2f-7fcfa4e8daf8 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 3a493863-6fda-4311-8271-48f093698726] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:05.986543 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06d97fb7-344a-4ec5-9a2f-7fcfa4e8daf8 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:05.987024 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06d97fb7-344a-4ec5-9a2f-7fcfa4e8daf8 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:05.987457 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06d97fb7-344a-4ec5-9a2f-7fcfa4e8daf8 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:05.988142 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06d97fb7-344a-4ec5-9a2f-7fcfa4e8daf8 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:05.988592 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06d97fb7-344a-4ec5-9a2f-7fcfa4e8daf8 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:05.989113 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06d97fb7-344a-4ec5-9a2f-7fcfa4e8daf8 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:06.127720 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-06d97fb7-344a-4ec5-9a2f-7fcfa4e8daf8 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:06.137236 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-06d97fb7-344a-4ec5-9a2f-7fcfa4e8daf8 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726" status: 200 len: 1367 microversion: 2.1 time: 0.161624 Aug 24 03:38:06.150709 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 382/773] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:05 2022] GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:07.000264 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-7d627b32-10b0-42f6-95ed-efc99f70158a tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:07.000869 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-7d627b32-10b0-42f6-95ed-efc99f70158a tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: 1de285c1-cf27-4c89-a56a-9d49322e3f42] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:07.007098 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7d627b32-10b0-42f6-95ed-efc99f70158a tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:07.007593 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7d627b32-10b0-42f6-95ed-efc99f70158a tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:07.008035 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7d627b32-10b0-42f6-95ed-efc99f70158a tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:07.008809 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7d627b32-10b0-42f6-95ed-efc99f70158a tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:07.009315 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7d627b32-10b0-42f6-95ed-efc99f70158a tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:07.009922 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7d627b32-10b0-42f6-95ed-efc99f70158a tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:07.095805 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.objects.instance [None req-7d627b32-10b0-42f6-95ed-efc99f70158a tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lazy-loading 'services' on Instance uuid 1de285c1-cf27-4c89-a56a-9d49322e3f42 {{(pid=120709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:38:07.158049 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-6ff7f9ab-1ab5-4f11-a9a8-8b256a7a3341 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:07.158923 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-6ff7f9ab-1ab5-4f11-a9a8-8b256a7a3341 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 3a493863-6fda-4311-8271-48f093698726] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:07.167583 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6ff7f9ab-1ab5-4f11-a9a8-8b256a7a3341 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:07.168093 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6ff7f9ab-1ab5-4f11-a9a8-8b256a7a3341 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:07.168564 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6ff7f9ab-1ab5-4f11-a9a8-8b256a7a3341 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:07.169476 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6ff7f9ab-1ab5-4f11-a9a8-8b256a7a3341 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:07.170121 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6ff7f9ab-1ab5-4f11-a9a8-8b256a7a3341 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:07.170553 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6ff7f9ab-1ab5-4f11-a9a8-8b256a7a3341 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:07.218731 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-7d627b32-10b0-42f6-95ed-efc99f70158a tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] 10.222.0.81 "DELETE /compute/v2.1/servers/1de285c1-cf27-4c89-a56a-9d49322e3f42/os-volume_attachments/e23bb49d-7467-410d-9869-cca7fe3aedc1" status: 202 len: 0 microversion: 2.1 time: 0.223007 Aug 24 03:38:07.219349 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 392/774] 10.222.0.81 () {58 vars in 1416 bytes} [Wed Aug 24 03:38:06 2022] DELETE /compute/v2.1/servers/1de285c1-cf27-4c89-a56a-9d49322e3f42/os-volume_attachments/e23bb49d-7467-410d-9869-cca7fe3aedc1 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:38:07.313359 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-6ff7f9ab-1ab5-4f11-a9a8-8b256a7a3341 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:07.321712 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-6ff7f9ab-1ab5-4f11-a9a8-8b256a7a3341 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726" status: 200 len: 1367 microversion: 2.1 time: 0.167486 Aug 24 03:38:07.329940 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 383/775] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:07 2022] GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:08.343638 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-eac8ae86-3a98-4db8-9525-51fd6f40b23b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:08.344255 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-eac8ae86-3a98-4db8-9525-51fd6f40b23b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 3a493863-6fda-4311-8271-48f093698726] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:08.344733 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-0400c0fb-3b58-48ee-89b8-ab8c1c96a901 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:08.345365 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-0400c0fb-3b58-48ee-89b8-ab8c1c96a901 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: 1de285c1-cf27-4c89-a56a-9d49322e3f42] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:08.350684 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eac8ae86-3a98-4db8-9525-51fd6f40b23b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:08.351166 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eac8ae86-3a98-4db8-9525-51fd6f40b23b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:08.351426 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0400c0fb-3b58-48ee-89b8-ab8c1c96a901 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:08.351600 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eac8ae86-3a98-4db8-9525-51fd6f40b23b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:08.351903 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0400c0fb-3b58-48ee-89b8-ab8c1c96a901 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:08.352290 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eac8ae86-3a98-4db8-9525-51fd6f40b23b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:08.352391 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0400c0fb-3b58-48ee-89b8-ab8c1c96a901 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:08.352739 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eac8ae86-3a98-4db8-9525-51fd6f40b23b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:08.353034 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0400c0fb-3b58-48ee-89b8-ab8c1c96a901 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:08.353191 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eac8ae86-3a98-4db8-9525-51fd6f40b23b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:08.353628 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0400c0fb-3b58-48ee-89b8-ab8c1c96a901 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:08.354538 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0400c0fb-3b58-48ee-89b8-ab8c1c96a901 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:08.378783 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-0400c0fb-3b58-48ee-89b8-ab8c1c96a901 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: 1de285c1-cf27-4c89-a56a-9d49322e3f42] Going to try to terminate instance {{(pid=120709) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:38:08.457228 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-0400c0fb-3b58-48ee-89b8-ab8c1c96a901 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] 10.222.0.81 "DELETE /compute/v2.1/servers/1de285c1-cf27-4c89-a56a-9d49322e3f42" status: 204 len: 0 microversion: 2.1 time: 0.117121 Aug 24 03:38:08.457816 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 393/776] 10.222.0.81 () {58 vars in 1239 bytes} [Wed Aug 24 03:38:08 2022] DELETE /compute/v2.1/servers/1de285c1-cf27-4c89-a56a-9d49322e3f42 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:38:08.468989 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-4dc236f2-8ecf-4b88-b229-138bf44ffc6e tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:08.469875 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-4dc236f2-8ecf-4b88-b229-138bf44ffc6e tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: 1de285c1-cf27-4c89-a56a-9d49322e3f42] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:08.476028 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4dc236f2-8ecf-4b88-b229-138bf44ffc6e tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:08.476523 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4dc236f2-8ecf-4b88-b229-138bf44ffc6e tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:08.477004 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4dc236f2-8ecf-4b88-b229-138bf44ffc6e tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:08.477709 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4dc236f2-8ecf-4b88-b229-138bf44ffc6e tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:08.478170 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4dc236f2-8ecf-4b88-b229-138bf44ffc6e tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:08.479346 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4dc236f2-8ecf-4b88-b229-138bf44ffc6e tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:08.496844 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-eac8ae86-3a98-4db8-9525-51fd6f40b23b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:08.504445 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-eac8ae86-3a98-4db8-9525-51fd6f40b23b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726" status: 200 len: 1367 microversion: 2.1 time: 0.164906 Aug 24 03:38:08.505037 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 384/777] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:08 2022] GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:08.610430 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-4dc236f2-8ecf-4b88-b229-138bf44ffc6e tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5143313cddbb4f56bf48d84167069c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f494a609f241328d85790280b204b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:08.618261 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-4dc236f2-8ecf-4b88-b229-138bf44ffc6e tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] 10.222.0.81 "GET /compute/v2.1/servers/1de285c1-cf27-4c89-a56a-9d49322e3f42" status: 200 len: 1514 microversion: 2.1 time: 0.155828 Aug 24 03:38:08.618835 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 394/778] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:08 2022] GET /compute/v2.1/servers/1de285c1-cf27-4c89-a56a-9d49322e3f42 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:09.484730 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-fa323b74-6e7b-40e9-8240-d56ca036e8b3 req-fbc70b43-d324-498c-9c97-b07a2b150d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a493863-6fda-4311-8271-48f093698726", "name": "network-vif-plugged", "status": "completed", "tag": "a3e235e1-9925-4bd2-ad87-9f5d93265022"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:09.496161 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-fa323b74-6e7b-40e9-8240-d56ca036e8b3 req-fbc70b43-d324-498c-9c97-b07a2b150d11 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:09.496651 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-fa323b74-6e7b-40e9-8240-d56ca036e8b3 req-fbc70b43-d324-498c-9c97-b07a2b150d11 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:09.497789 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-fa323b74-6e7b-40e9-8240-d56ca036e8b3 req-fbc70b43-d324-498c-9c97-b07a2b150d11 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:09.509264 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-fa323b74-6e7b-40e9-8240-d56ca036e8b3 req-fbc70b43-d324-498c-9c97-b07a2b150d11 service nova] Creating event network-vif-plugged:a3e235e1-9925-4bd2-ad87-9f5d93265022 for instance 3a493863-6fda-4311-8271-48f093698726 on hv-cinder-85426 Aug 24 03:38:09.514660 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-fa323b74-6e7b-40e9-8240-d56ca036e8b3 req-fbc70b43-d324-498c-9c97-b07a2b150d11 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034492 Aug 24 03:38:09.515246 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 385/779] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:09.525186 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-f96dd608-d86b-469f-ae62-0147b9aa9dd7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:09.525791 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-f96dd608-d86b-469f-ae62-0147b9aa9dd7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 3a493863-6fda-4311-8271-48f093698726] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:09.532254 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f96dd608-d86b-469f-ae62-0147b9aa9dd7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:09.532731 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f96dd608-d86b-469f-ae62-0147b9aa9dd7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:09.533208 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f96dd608-d86b-469f-ae62-0147b9aa9dd7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:09.533911 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f96dd608-d86b-469f-ae62-0147b9aa9dd7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:09.534371 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f96dd608-d86b-469f-ae62-0147b9aa9dd7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:09.534800 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f96dd608-d86b-469f-ae62-0147b9aa9dd7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:09.639994 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-748e6a7f-a50d-438a-a2c1-f2a41ef6606b tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:09.640723 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-748e6a7f-a50d-438a-a2c1-f2a41ef6606b tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: 1de285c1-cf27-4c89-a56a-9d49322e3f42] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:09.646875 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-748e6a7f-a50d-438a-a2c1-f2a41ef6606b tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:09.647364 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-748e6a7f-a50d-438a-a2c1-f2a41ef6606b tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:09.647804 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-748e6a7f-a50d-438a-a2c1-f2a41ef6606b tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:09.648499 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-748e6a7f-a50d-438a-a2c1-f2a41ef6606b tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:09.648985 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-748e6a7f-a50d-438a-a2c1-f2a41ef6606b tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:09.649414 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-748e6a7f-a50d-438a-a2c1-f2a41ef6606b tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:09.664051 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-f96dd608-d86b-469f-ae62-0147b9aa9dd7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:09.672745 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-f96dd608-d86b-469f-ae62-0147b9aa9dd7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726" status: 200 len: 1367 microversion: 2.1 time: 0.151309 Aug 24 03:38:09.673341 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 395/780] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:09 2022] GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:09.783947 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-748e6a7f-a50d-438a-a2c1-f2a41ef6606b tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5143313cddbb4f56bf48d84167069c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f494a609f241328d85790280b204b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:09.792312 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-748e6a7f-a50d-438a-a2c1-f2a41ef6606b tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] 10.222.0.81 "GET /compute/v2.1/servers/1de285c1-cf27-4c89-a56a-9d49322e3f42" status: 200 len: 1514 microversion: 2.1 time: 0.156644 Aug 24 03:38:09.792900 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 386/781] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:09 2022] GET /compute/v2.1/servers/1de285c1-cf27-4c89-a56a-9d49322e3f42 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:10.694809 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-69c100d2-22be-4feb-8509-37828ea0ecc5 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:10.695432 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-69c100d2-22be-4feb-8509-37828ea0ecc5 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 3a493863-6fda-4311-8271-48f093698726] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:10.702867 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-69c100d2-22be-4feb-8509-37828ea0ecc5 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:10.703365 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-69c100d2-22be-4feb-8509-37828ea0ecc5 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:10.703808 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-69c100d2-22be-4feb-8509-37828ea0ecc5 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:10.704508 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-69c100d2-22be-4feb-8509-37828ea0ecc5 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:10.705008 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-69c100d2-22be-4feb-8509-37828ea0ecc5 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:10.705443 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-69c100d2-22be-4feb-8509-37828ea0ecc5 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:10.813718 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ce6094b2-8506-4fb9-9105-81f51adb53f9 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:10.814420 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ce6094b2-8506-4fb9-9105-81f51adb53f9 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: 1de285c1-cf27-4c89-a56a-9d49322e3f42] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:10.821111 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ce6094b2-8506-4fb9-9105-81f51adb53f9 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:10.821555 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ce6094b2-8506-4fb9-9105-81f51adb53f9 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:10.822027 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ce6094b2-8506-4fb9-9105-81f51adb53f9 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:10.823532 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ce6094b2-8506-4fb9-9105-81f51adb53f9 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:10.823992 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ce6094b2-8506-4fb9-9105-81f51adb53f9 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:10.824417 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ce6094b2-8506-4fb9-9105-81f51adb53f9 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:10.835896 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-69c100d2-22be-4feb-8509-37828ea0ecc5 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:10.844607 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-69c100d2-22be-4feb-8509-37828ea0ecc5 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726" status: 200 len: 1367 microversion: 2.1 time: 0.153577 Aug 24 03:38:10.845609 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 396/782] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:10 2022] GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:10.971839 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ce6094b2-8506-4fb9-9105-81f51adb53f9 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5143313cddbb4f56bf48d84167069c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f494a609f241328d85790280b204b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:10.980093 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ce6094b2-8506-4fb9-9105-81f51adb53f9 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] 10.222.0.81 "GET /compute/v2.1/servers/1de285c1-cf27-4c89-a56a-9d49322e3f42" status: 200 len: 1514 microversion: 2.1 time: 0.170256 Aug 24 03:38:10.980669 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 387/783] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:10 2022] GET /compute/v2.1/servers/1de285c1-cf27-4c89-a56a-9d49322e3f42 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:11.289156 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-5d3b5d31-fa55-44bf-abfb-a5c6f6289f95 req-dd6d7e1e-a66e-4c00-bed4-29deba90a7b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1de285c1-cf27-4c89-a56a-9d49322e3f42", "name": "network-vif-deleted", "tag": "aa70beb4-13fb-47e3-a96f-69b0fe3a7aec"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:11.298694 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-5d3b5d31-fa55-44bf-abfb-a5c6f6289f95 req-dd6d7e1e-a66e-4c00-bed4-29deba90a7b5 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:11.299188 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-5d3b5d31-fa55-44bf-abfb-a5c6f6289f95 req-dd6d7e1e-a66e-4c00-bed4-29deba90a7b5 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:11.299615 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-5d3b5d31-fa55-44bf-abfb-a5c6f6289f95 req-dd6d7e1e-a66e-4c00-bed4-29deba90a7b5 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:11.310809 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-5d3b5d31-fa55-44bf-abfb-a5c6f6289f95 req-dd6d7e1e-a66e-4c00-bed4-29deba90a7b5 service nova] Creating event network-vif-deleted:aa70beb4-13fb-47e3-a96f-69b0fe3a7aec for instance 1de285c1-cf27-4c89-a56a-9d49322e3f42 on hv-cinder-85426 Aug 24 03:38:11.315626 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-5d3b5d31-fa55-44bf-abfb-a5c6f6289f95 req-dd6d7e1e-a66e-4c00-bed4-29deba90a7b5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030163 Aug 24 03:38:11.316186 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 397/784] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:11.865781 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-136892b7-e96f-4cb3-91b0-ea3f791008a3 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:11.866388 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-136892b7-e96f-4cb3-91b0-ea3f791008a3 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 3a493863-6fda-4311-8271-48f093698726] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:11.868294 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=2 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:11.869649 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=6 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:11.877716 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-136892b7-e96f-4cb3-91b0-ea3f791008a3 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:11.878235 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-136892b7-e96f-4cb3-91b0-ea3f791008a3 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:11.878667 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-136892b7-e96f-4cb3-91b0-ea3f791008a3 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:11.879355 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-136892b7-e96f-4cb3-91b0-ea3f791008a3 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:11.879800 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-136892b7-e96f-4cb3-91b0-ea3f791008a3 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:11.880221 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-136892b7-e96f-4cb3-91b0-ea3f791008a3 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:12.001009 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell0:SELECT=6 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:12.006221 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-a79b49f5-2315-487a-b95a-e7500c9b95da tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:12.006933 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-a79b49f5-2315-487a-b95a-e7500c9b95da tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: 1de285c1-cf27-4c89-a56a-9d49322e3f42] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:12.010569 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-136892b7-e96f-4cb3-91b0-ea3f791008a3 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:12.014255 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a79b49f5-2315-487a-b95a-e7500c9b95da tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:12.014752 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a79b49f5-2315-487a-b95a-e7500c9b95da tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:12.015198 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a79b49f5-2315-487a-b95a-e7500c9b95da tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:12.015900 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a79b49f5-2315-487a-b95a-e7500c9b95da tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:12.016358 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a79b49f5-2315-487a-b95a-e7500c9b95da tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:12.016811 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a79b49f5-2315-487a-b95a-e7500c9b95da tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:12.019310 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-136892b7-e96f-4cb3-91b0-ea3f791008a3 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726" status: 200 len: 1557 microversion: 2.1 time: 0.157338 Aug 24 03:38:12.020416 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 388/785] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:11 2022] GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726 => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:12.042044 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-eb8a9f1a-0fe0-4adf-9451-d92a9d3cef77 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:12.042538 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-eb8a9f1a-0fe0-4adf-9451-d92a9d3cef77 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 3a493863-6fda-4311-8271-48f093698726] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:12.048545 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eb8a9f1a-0fe0-4adf-9451-d92a9d3cef77 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:12.049192 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eb8a9f1a-0fe0-4adf-9451-d92a9d3cef77 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:12.049624 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eb8a9f1a-0fe0-4adf-9451-d92a9d3cef77 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:12.050308 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eb8a9f1a-0fe0-4adf-9451-d92a9d3cef77 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:12.050755 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eb8a9f1a-0fe0-4adf-9451-d92a9d3cef77 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:12.051197 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eb8a9f1a-0fe0-4adf-9451-d92a9d3cef77 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:12.055514 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a79b49f5-2315-487a-b95a-e7500c9b95da tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:12.055996 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a79b49f5-2315-487a-b95a-e7500c9b95da tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:12.056434 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-a79b49f5-2315-487a-b95a-e7500c9b95da tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:12.057594 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.objects.instance [None req-a79b49f5-2315-487a-b95a-e7500c9b95da tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lazy-loading 'fault' on Instance uuid 1de285c1-cf27-4c89-a56a-9d49322e3f42 {{(pid=120709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:38:12.110262 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-a79b49f5-2315-487a-b95a-e7500c9b95da tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5143313cddbb4f56bf48d84167069c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f494a609f241328d85790280b204b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:12.118293 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-a79b49f5-2315-487a-b95a-e7500c9b95da tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] 10.222.0.81 "GET /compute/v2.1/servers/1de285c1-cf27-4c89-a56a-9d49322e3f42" status: 200 len: 1309 microversion: 2.1 time: 0.118695 Aug 24 03:38:12.119534 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 398/786] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:11 2022] GET /compute/v2.1/servers/1de285c1-cf27-4c89-a56a-9d49322e3f42 => generated 1309 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:12.145446 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-eb8a9f1a-0fe0-4adf-9451-d92a9d3cef77 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107842 Aug 24 03:38:12.146060 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 389/787] 10.222.0.81 () {58 vars in 1275 bytes} [Wed Aug 24 03:38:12 2022] GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:38:13.061691 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-6edf363e-0c0c-45ba-aaab-b71a093ce0eb req-cd9468b3-26a7-4b80-9ef6-ae6fc17e192b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a493863-6fda-4311-8271-48f093698726", "tag": "a3e235e1-9925-4bd2-ad87-9f5d93265022"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:13.071437 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-6edf363e-0c0c-45ba-aaab-b71a093ce0eb req-cd9468b3-26a7-4b80-9ef6-ae6fc17e192b service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:13.071927 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-6edf363e-0c0c-45ba-aaab-b71a093ce0eb req-cd9468b3-26a7-4b80-9ef6-ae6fc17e192b service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:13.073076 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-6edf363e-0c0c-45ba-aaab-b71a093ce0eb req-cd9468b3-26a7-4b80-9ef6-ae6fc17e192b service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:13.083987 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-6edf363e-0c0c-45ba-aaab-b71a093ce0eb req-cd9468b3-26a7-4b80-9ef6-ae6fc17e192b service nova] Creating event network-changed:a3e235e1-9925-4bd2-ad87-9f5d93265022 for instance 3a493863-6fda-4311-8271-48f093698726 on hv-cinder-85426 Aug 24 03:38:13.089914 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-6edf363e-0c0c-45ba-aaab-b71a093ce0eb req-cd9468b3-26a7-4b80-9ef6-ae6fc17e192b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031811 Aug 24 03:38:13.090504 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 399/788] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:38:13.142055 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-86e7b853-2285-4609-a899-e9add338ddb5 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:13.142694 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-86e7b853-2285-4609-a899-e9add338ddb5 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: 1de285c1-cf27-4c89-a56a-9d49322e3f42] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:13.149370 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-86e7b853-2285-4609-a899-e9add338ddb5 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:13.150128 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-86e7b853-2285-4609-a899-e9add338ddb5 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:13.151247 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-86e7b853-2285-4609-a899-e9add338ddb5 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:13.151979 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-86e7b853-2285-4609-a899-e9add338ddb5 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:13.152438 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-86e7b853-2285-4609-a899-e9add338ddb5 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:13.153108 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-86e7b853-2285-4609-a899-e9add338ddb5 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:13.167949 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-86e7b853-2285-4609-a899-e9add338ddb5 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] HTTP exception thrown: Instance 1de285c1-cf27-4c89-a56a-9d49322e3f42 could not be found. Aug 24 03:38:13.169668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-86e7b853-2285-4609-a899-e9add338ddb5 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Request method failure captured: Aug 24 03:38:13.169668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/servers/1de285c1-cf27-4c89-a56a-9d49322e3f42 HTTP/1.1 Aug 24 03:38:13.169668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 24 03:38:13.169668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 24 03:38:13.169668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Connection: close Aug 24 03:38:13.169668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 24 03:38:13.169668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 24 03:38:13.169668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Host: 10.222.0.81 Aug 24 03:38:13.169668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 24 03:38:13.169668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.11 Aug 24 03:38:13.169668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjBZzrvCyuHlmzjPDuz_RWZQzynoBIqLD82Y6oNoUwUcqx5svurxN4uug-JonRuhfLWT7gkzLphMOUYUPK_Pp_-d7gP6l9_fu_HbsKnqkBWu3IGnrboA4Pdt9-mbUHQ40oUeiWbcebo1rxppWK45pIHfrS18kJPEgv1Cipzz00O_i28w8 Aug 24 03:38:13.169668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 24 03:38:13.169668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 24 03:38:13.169668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 24 03:38:13.169668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 24 03:38:13.169668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 24 03:38:13.169668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 24 03:38:13.169668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Id: 69f494a609f241328d85790280b204b8 Aug 24 03:38:13.169668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-VolumesSnapshotTestJSON-707471405 Aug 24 03:38:13.169668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 24 03:38:13.169668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 24 03:38:13.171304 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/69f494a609f241328d85790280b204b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_69f494a609f241328d85790280b204b8", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/69f494a609f241328d85790280b204b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/69f494a609f241328d85790280b204b8"}]}] Aug 24 03:38:13.171304 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-VolumesSnapshotTestJSON-707471405 Aug 24 03:38:13.171304 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 69f494a609f241328d85790280b204b8 Aug 24 03:38:13.171304 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-707471405 Aug 24 03:38:13.171304 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User: tempest-VolumesSnapshotTestJSON-707471405-project Aug 24 03:38:13.171304 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 24 03:38:13.171304 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 24 03:38:13.171304 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Id: 5143313cddbb4f56bf48d84167069c74 Aug 24 03:38:13.171304 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-VolumesSnapshotTestJSON-707471405-project Aug 24 03:38:13.171304 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: method: > Aug 24 03:38:13.171304 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: exception: Instance 1de285c1-cf27-4c89-a56a-9d49322e3f42 could not be found. Aug 24 03:38:13.171304 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: action_args: {'id': '1de285c1-cf27-4c89-a56a-9d49322e3f42'} Aug 24 03:38:13.172296 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:38:13.172296 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:13.172296 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:38:13.172296 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:38:13.172296 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:38:13.172296 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:38:13.172296 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:38:13.172296 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:38:13.172296 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:38:13.172296 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:38:13.172296 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1de285c1-cf27-4c89-a56a-9d49322e3f42 could not be found. Aug 24 03:38:13.172296 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:38:13.172296 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:13.172296 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:38:13.172296 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:13.172296 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:13.172296 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:13.172296 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:38:13.172296 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:38:13.172296 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:38:13.173913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:38:13.173913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:38:13.173913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:38:13.173913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:38:13.173913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:38:13.173913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:38:13.173913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:38:13.173913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1de285c1-cf27-4c89-a56a-9d49322e3f42 could not be found. Aug 24 03:38:13.173913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:38:13.173913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:13.173913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:38:13.173913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:13.173913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:13.173913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:13.173913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:38:13.173913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:38:13.173913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1de285c1-cf27-4c89-a56a-9d49322e3f42 could not be found. Aug 24 03:38:13.173913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:38:13.175297 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-86e7b853-2285-4609-a899-e9add338ddb5 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Returning 404 to user: Instance 1de285c1-cf27-4c89-a56a-9d49322e3f42 could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:38:13.175297 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-86e7b853-2285-4609-a899-e9add338ddb5 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] 10.222.0.81 "GET /compute/v2.1/servers/1de285c1-cf27-4c89-a56a-9d49322e3f42" status: 404 len: 111 microversion: 2.1 time: 0.033571 Aug 24 03:38:13.180943 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 390/789] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:13 2022] GET /compute/v2.1/servers/1de285c1-cf27-4c89-a56a-9d49322e3f42 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:38:19.192107 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-e2b7a5da-c592-444f-9011-a6161b23a287 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:19.192722 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-e2b7a5da-c592-444f-9011-a6161b23a287 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:19.195246 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:19.202595 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e2b7a5da-c592-444f-9011-a6161b23a287 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:19.203166 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e2b7a5da-c592-444f-9011-a6161b23a287 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:19.203605 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e2b7a5da-c592-444f-9011-a6161b23a287 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:19.204285 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e2b7a5da-c592-444f-9011-a6161b23a287 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:19.204732 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e2b7a5da-c592-444f-9011-a6161b23a287 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:19.205178 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e2b7a5da-c592-444f-9011-a6161b23a287 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:19.229072 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.objects.instance [None req-e2b7a5da-c592-444f-9011-a6161b23a287 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lazy-loading 'flavor' on Instance uuid 7ee318a0-695b-431d-98cc-0d21560a2508 {{(pid=120709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:38:19.299724 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-e2b7a5da-c592-444f-9011-a6161b23a287 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "POST /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508/action" status: 202 len: 0 microversion: 2.1 time: 0.111592 Aug 24 03:38:19.300328 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 400/790] 10.222.0.81 () {60 vars in 1278 bytes} [Wed Aug 24 03:38:19 2022] POST /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:38:19.308549 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-6bf38505-55f6-4d9b-9f29-515b51e3c6ab tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:19.309174 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-6bf38505-55f6-4d9b-9f29-515b51e3c6ab tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:19.315565 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6bf38505-55f6-4d9b-9f29-515b51e3c6ab tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:19.316047 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6bf38505-55f6-4d9b-9f29-515b51e3c6ab tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:19.316480 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6bf38505-55f6-4d9b-9f29-515b51e3c6ab tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:19.317201 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6bf38505-55f6-4d9b-9f29-515b51e3c6ab tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:19.317657 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6bf38505-55f6-4d9b-9f29-515b51e3c6ab tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:19.318080 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-6bf38505-55f6-4d9b-9f29-515b51e3c6ab tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:19.451488 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-6bf38505-55f6-4d9b-9f29-515b51e3c6ab tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:19.459206 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-6bf38505-55f6-4d9b-9f29-515b51e3c6ab tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1568 microversion: 2.1 time: 0.154556 Aug 24 03:38:19.459761 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 391/791] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:19 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:20.481809 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-938b7e9b-0aa5-4714-bf35-732fd7a3ac39 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:20.482428 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-938b7e9b-0aa5-4714-bf35-732fd7a3ac39 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:20.488724 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-938b7e9b-0aa5-4714-bf35-732fd7a3ac39 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:20.489234 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-938b7e9b-0aa5-4714-bf35-732fd7a3ac39 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:20.489673 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-938b7e9b-0aa5-4714-bf35-732fd7a3ac39 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:20.490361 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-938b7e9b-0aa5-4714-bf35-732fd7a3ac39 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:20.490814 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-938b7e9b-0aa5-4714-bf35-732fd7a3ac39 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:20.491244 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-938b7e9b-0aa5-4714-bf35-732fd7a3ac39 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:20.627250 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-938b7e9b-0aa5-4714-bf35-732fd7a3ac39 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:20.635325 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-938b7e9b-0aa5-4714-bf35-732fd7a3ac39 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1568 microversion: 2.1 time: 0.158720 Aug 24 03:38:20.644009 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 401/792] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:20 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:21.067048 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c90becd6-837b-4f93-bb73-e331ea616b48 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-663774509", "imageRef": "b7a40f0c-20c2-44cd-8b0e-f6e73a007d3e", "flavorRef": "452", "networks": [{"uuid": "d18813c9-12da-4d54-a359-55f756fd2f82"}]}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:21.122404 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.network.neutron [None req-c90becd6-837b-4f93-bb73-e331ea616b48 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] validate_networks() for [('d18813c9-12da-4d54-a359-55f756fd2f82', None, None, None, None, None)] {{(pid=120708) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:38:21.657229 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-2a8f4ce2-a66d-4795-bb25-e22ff5e7f2f0 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:21.657825 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-2a8f4ce2-a66d-4795-bb25-e22ff5e7f2f0 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:21.664344 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2a8f4ce2-a66d-4795-bb25-e22ff5e7f2f0 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:21.664855 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2a8f4ce2-a66d-4795-bb25-e22ff5e7f2f0 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:21.665291 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2a8f4ce2-a66d-4795-bb25-e22ff5e7f2f0 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:21.665994 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2a8f4ce2-a66d-4795-bb25-e22ff5e7f2f0 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:21.666451 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2a8f4ce2-a66d-4795-bb25-e22ff5e7f2f0 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:21.666872 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2a8f4ce2-a66d-4795-bb25-e22ff5e7f2f0 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:21.718278 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-c90becd6-837b-4f93-bb73-e331ea616b48 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Flavor limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:38:21.718700 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-c90becd6-837b-4f93-bb73-e331ea616b48 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Image limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:38:21.719168 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-c90becd6-837b-4f93-bb73-e331ea616b48 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Flavor pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:38:21.719612 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-c90becd6-837b-4f93-bb73-e331ea616b48 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Image pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:38:21.720018 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-c90becd6-837b-4f93-bb73-e331ea616b48 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:38:21.728631 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c90becd6-837b-4f93-bb73-e331ea616b48 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:21.729132 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c90becd6-837b-4f93-bb73-e331ea616b48 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:21.729594 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c90becd6-837b-4f93-bb73-e331ea616b48 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:21.730319 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c90becd6-837b-4f93-bb73-e331ea616b48 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:21.730768 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c90becd6-837b-4f93-bb73-e331ea616b48 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:21.731185 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c90becd6-837b-4f93-bb73-e331ea616b48 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:21.748131 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-c90becd6-837b-4f93-bb73-e331ea616b48 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Getting quotas for project 69f494a609f241328d85790280b204b8. Resources: {'ram', 'instances', 'cores'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:38:21.752323 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-c90becd6-837b-4f93-bb73-e331ea616b48 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Getting quotas for user 5143313cddbb4f56bf48d84167069c74 and project 69f494a609f241328d85790280b204b8. Resources: {'ram', 'instances', 'cores'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:38:21.763840 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c90becd6-837b-4f93-bb73-e331ea616b48 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Going to run 1 instances... {{(pid=120708) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:38:21.766739 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c90becd6-837b-4f93-bb73-e331ea616b48 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: f0b99435-b9be-4877-aabe-7ce35db35517] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b7a40f0c-20c2-44cd-8b0e-f6e73a007d3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120708) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:38:21.805393 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-2a8f4ce2-a66d-4795-bb25-e22ff5e7f2f0 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:21.813490 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-2a8f4ce2-a66d-4795-bb25-e22ff5e7f2f0 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1568 microversion: 2.1 time: 0.160105 Aug 24 03:38:21.814066 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 402/793] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:21 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:21.815853 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c90becd6-837b-4f93-bb73-e331ea616b48 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.752688 Aug 24 03:38:21.816484 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 392/794] 10.222.0.81 () {60 vars in 1147 bytes} [Wed Aug 24 03:38:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:38:21.827178 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-536378dd-7724-4e9a-8811-23eb72ff12b6 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:21.827796 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-536378dd-7724-4e9a-8811-23eb72ff12b6 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: f0b99435-b9be-4877-aabe-7ce35db35517] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:21.881189 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-536378dd-7724-4e9a-8811-23eb72ff12b6 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5143313cddbb4f56bf48d84167069c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f494a609f241328d85790280b204b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:21.889144 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-536378dd-7724-4e9a-8811-23eb72ff12b6 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] 10.222.0.81 "GET /compute/v2.1/servers/f0b99435-b9be-4877-aabe-7ce35db35517" status: 200 len: 1218 microversion: 2.1 time: 0.065791 Aug 24 03:38:21.889726 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 403/795] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:21 2022] GET /compute/v2.1/servers/f0b99435-b9be-4877-aabe-7ce35db35517 => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:22.837687 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ab5d1733-2d4e-4687-967b-c0df4c28dd82 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:22.839828 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ab5d1733-2d4e-4687-967b-c0df4c28dd82 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:22.847268 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ab5d1733-2d4e-4687-967b-c0df4c28dd82 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:22.847762 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ab5d1733-2d4e-4687-967b-c0df4c28dd82 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:22.848203 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ab5d1733-2d4e-4687-967b-c0df4c28dd82 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:22.848944 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ab5d1733-2d4e-4687-967b-c0df4c28dd82 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:22.849403 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ab5d1733-2d4e-4687-967b-c0df4c28dd82 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:22.849832 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ab5d1733-2d4e-4687-967b-c0df4c28dd82 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:22.909766 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-6a633dce-9d6f-48e7-b98f-a8e9a4896bbc tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:22.911153 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-6a633dce-9d6f-48e7-b98f-a8e9a4896bbc tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: f0b99435-b9be-4877-aabe-7ce35db35517] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:22.919880 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6a633dce-9d6f-48e7-b98f-a8e9a4896bbc tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:22.920667 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6a633dce-9d6f-48e7-b98f-a8e9a4896bbc tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:22.921319 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6a633dce-9d6f-48e7-b98f-a8e9a4896bbc tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:22.922805 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6a633dce-9d6f-48e7-b98f-a8e9a4896bbc tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:22.923481 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6a633dce-9d6f-48e7-b98f-a8e9a4896bbc tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:22.924065 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6a633dce-9d6f-48e7-b98f-a8e9a4896bbc tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:23.026087 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-6a633dce-9d6f-48e7-b98f-a8e9a4896bbc tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5143313cddbb4f56bf48d84167069c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f494a609f241328d85790280b204b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:23.034178 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:23.039978 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-6a633dce-9d6f-48e7-b98f-a8e9a4896bbc tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] 10.222.0.81 "GET /compute/v2.1/servers/f0b99435-b9be-4877-aabe-7ce35db35517" status: 200 len: 1278 microversion: 2.1 time: 0.134175 Aug 24 03:38:23.040756 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 404/796] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:22 2022] GET /compute/v2.1/servers/f0b99435-b9be-4877-aabe-7ce35db35517 => generated 1278 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:23.053007 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ab5d1733-2d4e-4687-967b-c0df4c28dd82 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:23.062084 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ab5d1733-2d4e-4687-967b-c0df4c28dd82 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1568 microversion: 2.1 time: 0.228442 Aug 24 03:38:23.062636 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 393/797] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:22 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:24.062833 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-58ff99aa-a5d1-4e10-b9cc-61193865b2ad tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:24.063376 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-58ff99aa-a5d1-4e10-b9cc-61193865b2ad tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: f0b99435-b9be-4877-aabe-7ce35db35517] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:24.071156 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-58ff99aa-a5d1-4e10-b9cc-61193865b2ad tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:24.071643 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-58ff99aa-a5d1-4e10-b9cc-61193865b2ad tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:24.072083 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-58ff99aa-a5d1-4e10-b9cc-61193865b2ad tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:24.072784 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-58ff99aa-a5d1-4e10-b9cc-61193865b2ad tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:24.073290 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-58ff99aa-a5d1-4e10-b9cc-61193865b2ad tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:24.073720 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-58ff99aa-a5d1-4e10-b9cc-61193865b2ad tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:24.083589 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-5bdf1617-c584-4690-b8d7-6673bd30850b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:24.084260 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-5bdf1617-c584-4690-b8d7-6673bd30850b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:24.091602 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5bdf1617-c584-4690-b8d7-6673bd30850b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:24.092625 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5bdf1617-c584-4690-b8d7-6673bd30850b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:24.093288 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5bdf1617-c584-4690-b8d7-6673bd30850b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:24.094114 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5bdf1617-c584-4690-b8d7-6673bd30850b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:24.094568 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5bdf1617-c584-4690-b8d7-6673bd30850b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:24.094987 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5bdf1617-c584-4690-b8d7-6673bd30850b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:24.281089 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-58ff99aa-a5d1-4e10-b9cc-61193865b2ad tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5143313cddbb4f56bf48d84167069c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f494a609f241328d85790280b204b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:24.289450 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-58ff99aa-a5d1-4e10-b9cc-61193865b2ad tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] 10.222.0.81 "GET /compute/v2.1/servers/f0b99435-b9be-4877-aabe-7ce35db35517" status: 200 len: 1318 microversion: 2.1 time: 0.231860 Aug 24 03:38:24.290755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 405/798] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:24 2022] GET /compute/v2.1/servers/f0b99435-b9be-4877-aabe-7ce35db35517 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:24.294322 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-5bdf1617-c584-4690-b8d7-6673bd30850b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:24.302898 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-5bdf1617-c584-4690-b8d7-6673bd30850b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1568 microversion: 2.1 time: 0.223235 Aug 24 03:38:24.303468 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 394/799] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:24 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:24.492504 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-9d60c869-c95b-48f0-9560-227959371be4 req-4d5be581-ad9c-44a0-bec9-63ced2afee27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0b99435-b9be-4877-aabe-7ce35db35517", "tag": "44487cab-e8cf-4744-ae9d-f6bf08586370"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:24.503788 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-9d60c869-c95b-48f0-9560-227959371be4 req-4d5be581-ad9c-44a0-bec9-63ced2afee27 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:24.504279 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-9d60c869-c95b-48f0-9560-227959371be4 req-4d5be581-ad9c-44a0-bec9-63ced2afee27 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:24.504715 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-9d60c869-c95b-48f0-9560-227959371be4 req-4d5be581-ad9c-44a0-bec9-63ced2afee27 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:24.518977 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-9d60c869-c95b-48f0-9560-227959371be4 req-4d5be581-ad9c-44a0-bec9-63ced2afee27 service nova] Creating event network-changed:44487cab-e8cf-4744-ae9d-f6bf08586370 for instance f0b99435-b9be-4877-aabe-7ce35db35517 on hv-cinder-85426 Aug 24 03:38:24.523680 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-9d60c869-c95b-48f0-9560-227959371be4 req-4d5be581-ad9c-44a0-bec9-63ced2afee27 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035610 Aug 24 03:38:24.524276 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 406/800] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:25.314083 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-be00e01a-81db-4b21-b8d6-c8b6ee152de1 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:25.314646 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-be00e01a-81db-4b21-b8d6-c8b6ee152de1 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: f0b99435-b9be-4877-aabe-7ce35db35517] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:25.321405 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-be00e01a-81db-4b21-b8d6-c8b6ee152de1 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:25.321895 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-be00e01a-81db-4b21-b8d6-c8b6ee152de1 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:25.322338 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-be00e01a-81db-4b21-b8d6-c8b6ee152de1 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:25.323039 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-be00e01a-81db-4b21-b8d6-c8b6ee152de1 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:25.323513 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-be00e01a-81db-4b21-b8d6-c8b6ee152de1 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:25.323798 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-97ff6544-6574-4f4b-91db-22f541cc72d5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:25.324213 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-be00e01a-81db-4b21-b8d6-c8b6ee152de1 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:25.324533 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-97ff6544-6574-4f4b-91db-22f541cc72d5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:25.331588 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-97ff6544-6574-4f4b-91db-22f541cc72d5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:25.332066 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-97ff6544-6574-4f4b-91db-22f541cc72d5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:25.332501 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-97ff6544-6574-4f4b-91db-22f541cc72d5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:25.333226 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-97ff6544-6574-4f4b-91db-22f541cc72d5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:25.333681 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-97ff6544-6574-4f4b-91db-22f541cc72d5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:25.334107 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-97ff6544-6574-4f4b-91db-22f541cc72d5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:25.520899 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-be00e01a-81db-4b21-b8d6-c8b6ee152de1 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5143313cddbb4f56bf48d84167069c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f494a609f241328d85790280b204b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:25.525338 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-97ff6544-6574-4f4b-91db-22f541cc72d5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:25.529697 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-be00e01a-81db-4b21-b8d6-c8b6ee152de1 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] 10.222.0.81 "GET /compute/v2.1/servers/f0b99435-b9be-4877-aabe-7ce35db35517" status: 200 len: 1318 microversion: 2.1 time: 0.219509 Aug 24 03:38:25.530270 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 395/801] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:25 2022] GET /compute/v2.1/servers/f0b99435-b9be-4877-aabe-7ce35db35517 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:25.533614 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-97ff6544-6574-4f4b-91db-22f541cc72d5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1568 microversion: 2.1 time: 0.213988 Aug 24 03:38:25.534179 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 407/802] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:25 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1568 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:26.551402 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0faa4e90-6de5-4598-8230-24bfbec0f6c7 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:26.552016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0faa4e90-6de5-4598-8230-24bfbec0f6c7 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: f0b99435-b9be-4877-aabe-7ce35db35517] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:26.555163 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-45645e52-b7d8-4848-96ed-f31b06282477 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:26.555789 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-45645e52-b7d8-4848-96ed-f31b06282477 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:26.559099 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0faa4e90-6de5-4598-8230-24bfbec0f6c7 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:26.559591 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0faa4e90-6de5-4598-8230-24bfbec0f6c7 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:26.560030 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0faa4e90-6de5-4598-8230-24bfbec0f6c7 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:26.560735 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0faa4e90-6de5-4598-8230-24bfbec0f6c7 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:26.561212 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0faa4e90-6de5-4598-8230-24bfbec0f6c7 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:26.561636 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0faa4e90-6de5-4598-8230-24bfbec0f6c7 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:26.562103 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-45645e52-b7d8-4848-96ed-f31b06282477 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:26.562591 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-45645e52-b7d8-4848-96ed-f31b06282477 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:26.563038 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-45645e52-b7d8-4848-96ed-f31b06282477 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:26.563730 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-45645e52-b7d8-4848-96ed-f31b06282477 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:26.564259 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-45645e52-b7d8-4848-96ed-f31b06282477 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:26.564694 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-45645e52-b7d8-4848-96ed-f31b06282477 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:26.766539 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0faa4e90-6de5-4598-8230-24bfbec0f6c7 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5143313cddbb4f56bf48d84167069c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f494a609f241328d85790280b204b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:26.771226 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-45645e52-b7d8-4848-96ed-f31b06282477 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:26.774160 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0faa4e90-6de5-4598-8230-24bfbec0f6c7 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] 10.222.0.81 "GET /compute/v2.1/servers/f0b99435-b9be-4877-aabe-7ce35db35517" status: 200 len: 1318 microversion: 2.1 time: 0.226656 Aug 24 03:38:26.774732 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 396/803] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:26 2022] GET /compute/v2.1/servers/f0b99435-b9be-4877-aabe-7ce35db35517 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:26.780089 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-45645e52-b7d8-4848-96ed-f31b06282477 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1568 microversion: 2.1 time: 0.228654 Aug 24 03:38:26.780652 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 408/804] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:26 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:27.794945 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4a2992fc-5490-4bd0-83d4-c3b3d95e0e95 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:27.795567 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-4a2992fc-5490-4bd0-83d4-c3b3d95e0e95 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: f0b99435-b9be-4877-aabe-7ce35db35517] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:27.800885 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-20d74893-abe3-43e8-8a88-55f6d0c9c403 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:27.801593 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-20d74893-abe3-43e8-8a88-55f6d0c9c403 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:27.801964 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4a2992fc-5490-4bd0-83d4-c3b3d95e0e95 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:27.802456 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4a2992fc-5490-4bd0-83d4-c3b3d95e0e95 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:27.802900 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4a2992fc-5490-4bd0-83d4-c3b3d95e0e95 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:27.803602 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4a2992fc-5490-4bd0-83d4-c3b3d95e0e95 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:27.804059 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4a2992fc-5490-4bd0-83d4-c3b3d95e0e95 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:27.804497 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4a2992fc-5490-4bd0-83d4-c3b3d95e0e95 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:27.808749 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-20d74893-abe3-43e8-8a88-55f6d0c9c403 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:27.808914 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-20d74893-abe3-43e8-8a88-55f6d0c9c403 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:27.809439 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-20d74893-abe3-43e8-8a88-55f6d0c9c403 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:27.810139 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-20d74893-abe3-43e8-8a88-55f6d0c9c403 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:27.810600 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-20d74893-abe3-43e8-8a88-55f6d0c9c403 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:27.811027 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-20d74893-abe3-43e8-8a88-55f6d0c9c403 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:28.019736 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4a2992fc-5490-4bd0-83d4-c3b3d95e0e95 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5143313cddbb4f56bf48d84167069c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f494a609f241328d85790280b204b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:28.024041 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-20d74893-abe3-43e8-8a88-55f6d0c9c403 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:28.028570 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4a2992fc-5490-4bd0-83d4-c3b3d95e0e95 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] 10.222.0.81 "GET /compute/v2.1/servers/f0b99435-b9be-4877-aabe-7ce35db35517" status: 200 len: 1318 microversion: 2.1 time: 0.237585 Aug 24 03:38:28.029499 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 397/805] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:27 2022] GET /compute/v2.1/servers/f0b99435-b9be-4877-aabe-7ce35db35517 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:28.047304 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-20d74893-abe3-43e8-8a88-55f6d0c9c403 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1568 microversion: 2.1 time: 0.250214 Aug 24 03:38:28.047900 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 409/806] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:27 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1568 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:29.049551 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-5c57ae5b-8000-4b10-8a23-39c31ec40f09 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:29.050170 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-5c57ae5b-8000-4b10-8a23-39c31ec40f09 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: f0b99435-b9be-4877-aabe-7ce35db35517] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:29.056543 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5c57ae5b-8000-4b10-8a23-39c31ec40f09 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:29.057067 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5c57ae5b-8000-4b10-8a23-39c31ec40f09 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:29.057509 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5c57ae5b-8000-4b10-8a23-39c31ec40f09 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:29.058201 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5c57ae5b-8000-4b10-8a23-39c31ec40f09 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:29.058657 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5c57ae5b-8000-4b10-8a23-39c31ec40f09 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:29.059081 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5c57ae5b-8000-4b10-8a23-39c31ec40f09 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:29.068210 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-6f1b8dd7-fe0c-4d86-ac6a-824ec0163b68 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:29.068853 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-6f1b8dd7-fe0c-4d86-ac6a-824ec0163b68 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:29.075800 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6f1b8dd7-fe0c-4d86-ac6a-824ec0163b68 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:29.076287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6f1b8dd7-fe0c-4d86-ac6a-824ec0163b68 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:29.076732 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6f1b8dd7-fe0c-4d86-ac6a-824ec0163b68 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:29.077450 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6f1b8dd7-fe0c-4d86-ac6a-824ec0163b68 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:29.077915 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6f1b8dd7-fe0c-4d86-ac6a-824ec0163b68 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:29.078206 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=100 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:29.078364 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6f1b8dd7-fe0c-4d86-ac6a-824ec0163b68 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:29.254838 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-5c57ae5b-8000-4b10-8a23-39c31ec40f09 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5143313cddbb4f56bf48d84167069c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f494a609f241328d85790280b204b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:29.263551 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-5c57ae5b-8000-4b10-8a23-39c31ec40f09 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] 10.222.0.81 "GET /compute/v2.1/servers/f0b99435-b9be-4877-aabe-7ce35db35517" status: 200 len: 1318 microversion: 2.1 time: 0.217890 Aug 24 03:38:29.264124 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 398/807] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:29 2022] GET /compute/v2.1/servers/f0b99435-b9be-4877-aabe-7ce35db35517 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:29.267848 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-6f1b8dd7-fe0c-4d86-ac6a-824ec0163b68 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:29.275517 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-6f1b8dd7-fe0c-4d86-ac6a-824ec0163b68 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1568 microversion: 2.1 time: 0.211043 Aug 24 03:38:29.276068 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 410/808] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:29 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1568 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:29.641374 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-5bae310b-71b9-4b6d-af66-6940ce362b3a req-c343a6cc-5c13-4ce6-8bc7-e3d69a72a63c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0b99435-b9be-4877-aabe-7ce35db35517", "name": "network-vif-plugged", "status": "completed", "tag": "44487cab-e8cf-4744-ae9d-f6bf08586370"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:29.651979 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-5bae310b-71b9-4b6d-af66-6940ce362b3a req-c343a6cc-5c13-4ce6-8bc7-e3d69a72a63c service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:29.652731 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-5bae310b-71b9-4b6d-af66-6940ce362b3a req-c343a6cc-5c13-4ce6-8bc7-e3d69a72a63c service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:29.653908 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-5bae310b-71b9-4b6d-af66-6940ce362b3a req-c343a6cc-5c13-4ce6-8bc7-e3d69a72a63c service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:29.665112 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-5bae310b-71b9-4b6d-af66-6940ce362b3a req-c343a6cc-5c13-4ce6-8bc7-e3d69a72a63c service nova] Creating event network-vif-plugged:44487cab-e8cf-4744-ae9d-f6bf08586370 for instance f0b99435-b9be-4877-aabe-7ce35db35517 on hv-cinder-85426 Aug 24 03:38:29.670195 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-5bae310b-71b9-4b6d-af66-6940ce362b3a req-c343a6cc-5c13-4ce6-8bc7-e3d69a72a63c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033268 Aug 24 03:38:29.670965 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 399/809] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:30.283991 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-ebd190b0-446e-4526-aeed-74f9220f1d42 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:30.284507 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-ebd190b0-446e-4526-aeed-74f9220f1d42 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: f0b99435-b9be-4877-aabe-7ce35db35517] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:30.290531 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ebd190b0-446e-4526-aeed-74f9220f1d42 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:30.291016 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ebd190b0-446e-4526-aeed-74f9220f1d42 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:30.291453 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ebd190b0-446e-4526-aeed-74f9220f1d42 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:30.292692 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ebd190b0-446e-4526-aeed-74f9220f1d42 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:30.293264 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ebd190b0-446e-4526-aeed-74f9220f1d42 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:30.293691 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ebd190b0-446e-4526-aeed-74f9220f1d42 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:30.297058 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-3cc1e3ac-de57-4e62-9a2b-1b4736f6b7d1 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:30.297815 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-3cc1e3ac-de57-4e62-9a2b-1b4736f6b7d1 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:30.304266 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3cc1e3ac-de57-4e62-9a2b-1b4736f6b7d1 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:30.304750 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3cc1e3ac-de57-4e62-9a2b-1b4736f6b7d1 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:30.305225 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3cc1e3ac-de57-4e62-9a2b-1b4736f6b7d1 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:30.305920 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3cc1e3ac-de57-4e62-9a2b-1b4736f6b7d1 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:30.306375 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3cc1e3ac-de57-4e62-9a2b-1b4736f6b7d1 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:30.306797 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3cc1e3ac-de57-4e62-9a2b-1b4736f6b7d1 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:30.478954 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-ebd190b0-446e-4526-aeed-74f9220f1d42 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5143313cddbb4f56bf48d84167069c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f494a609f241328d85790280b204b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:30.486826 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-ebd190b0-446e-4526-aeed-74f9220f1d42 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] 10.222.0.81 "GET /compute/v2.1/servers/f0b99435-b9be-4877-aabe-7ce35db35517" status: 200 len: 1318 microversion: 2.1 time: 0.206860 Aug 24 03:38:30.487409 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 411/810] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:30 2022] GET /compute/v2.1/servers/f0b99435-b9be-4877-aabe-7ce35db35517 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:30.506777 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-3cc1e3ac-de57-4e62-9a2b-1b4736f6b7d1 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:30.515542 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-3cc1e3ac-de57-4e62-9a2b-1b4736f6b7d1 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1568 microversion: 2.1 time: 0.223782 Aug 24 03:38:30.516101 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 400/811] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:30 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1568 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:31.507763 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-3073fa95-7316-4783-9419-6bbdf7088f53 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:31.508408 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-3073fa95-7316-4783-9419-6bbdf7088f53 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: f0b99435-b9be-4877-aabe-7ce35db35517] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:31.515142 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3073fa95-7316-4783-9419-6bbdf7088f53 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:31.515623 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3073fa95-7316-4783-9419-6bbdf7088f53 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:31.516140 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3073fa95-7316-4783-9419-6bbdf7088f53 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:31.516860 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3073fa95-7316-4783-9419-6bbdf7088f53 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:31.517310 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3073fa95-7316-4783-9419-6bbdf7088f53 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:31.517732 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3073fa95-7316-4783-9419-6bbdf7088f53 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:31.537411 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7b35527e-cc81-4080-820d-ef3c37f0788f tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:31.538027 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-7b35527e-cc81-4080-820d-ef3c37f0788f tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:31.540411 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:31.548409 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7b35527e-cc81-4080-820d-ef3c37f0788f tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:31.548974 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7b35527e-cc81-4080-820d-ef3c37f0788f tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:31.557277 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7b35527e-cc81-4080-820d-ef3c37f0788f tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:31.558215 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7b35527e-cc81-4080-820d-ef3c37f0788f tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:31.558716 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7b35527e-cc81-4080-820d-ef3c37f0788f tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:31.559939 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7b35527e-cc81-4080-820d-ef3c37f0788f tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:31.708183 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-3073fa95-7316-4783-9419-6bbdf7088f53 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5143313cddbb4f56bf48d84167069c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f494a609f241328d85790280b204b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:31.716635 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-3073fa95-7316-4783-9419-6bbdf7088f53 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] 10.222.0.81 "GET /compute/v2.1/servers/f0b99435-b9be-4877-aabe-7ce35db35517" status: 200 len: 1507 microversion: 2.1 time: 0.213115 Aug 24 03:38:31.717547 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 412/812] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:31 2022] GET /compute/v2.1/servers/f0b99435-b9be-4877-aabe-7ce35db35517 => generated 1507 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:31.737762 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-3d38b487-0aaa-403b-ad8f-62e57db90aab tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f709d393-af9a-4d8e-b0ce-a8a34d6a9b7b", "device": "/dev/sdb"}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:31.738980 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-7b35527e-cc81-4080-820d-ef3c37f0788f tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:31.740086 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-3d38b487-0aaa-403b-ad8f-62e57db90aab tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: f0b99435-b9be-4877-aabe-7ce35db35517] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:31.741179 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=2 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:31.746349 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3d38b487-0aaa-403b-ad8f-62e57db90aab tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:31.746837 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3d38b487-0aaa-403b-ad8f-62e57db90aab tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:31.747273 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3d38b487-0aaa-403b-ad8f-62e57db90aab tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:31.747965 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3d38b487-0aaa-403b-ad8f-62e57db90aab tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:31.748298 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-7b35527e-cc81-4080-820d-ef3c37f0788f tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1568 microversion: 2.1 time: 0.214845 Aug 24 03:38:31.748503 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3d38b487-0aaa-403b-ad8f-62e57db90aab tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:31.748849 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-3d38b487-0aaa-403b-ad8f-62e57db90aab tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:31.748996 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 401/813] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:31 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1568 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:31.885535 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell0:SELECT=2 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:32.005583 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-3d38b487-0aaa-403b-ad8f-62e57db90aab tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] 10.222.0.81 "POST /compute/v2.1/servers/f0b99435-b9be-4877-aabe-7ce35db35517/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271492 Aug 24 03:38:32.006261 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 413/814] 10.222.0.81 () {60 vars in 1323 bytes} [Wed Aug 24 03:38:31 2022] POST /compute/v2.1/servers/f0b99435-b9be-4877-aabe-7ce35db35517/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:38:32.768681 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-3ecd1693-e066-40a0-9130-e302eaf82cda tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:32.769337 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-3ecd1693-e066-40a0-9130-e302eaf82cda tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:32.771149 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=6 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:32.777033 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3ecd1693-e066-40a0-9130-e302eaf82cda tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:32.777520 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3ecd1693-e066-40a0-9130-e302eaf82cda tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:32.777962 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3ecd1693-e066-40a0-9130-e302eaf82cda tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:32.778660 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3ecd1693-e066-40a0-9130-e302eaf82cda tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:32.779119 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3ecd1693-e066-40a0-9130-e302eaf82cda tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:32.779548 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3ecd1693-e066-40a0-9130-e302eaf82cda tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:32.912343 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-3ecd1693-e066-40a0-9130-e302eaf82cda tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:32.921538 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-3ecd1693-e066-40a0-9130-e302eaf82cda tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1568 microversion: 2.1 time: 0.156735 Aug 24 03:38:32.922109 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 402/815] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:32 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:33.943527 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-907f004a-108c-43bd-85fe-5111d16db374 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:33.944225 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-907f004a-108c-43bd-85fe-5111d16db374 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:33.951533 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-907f004a-108c-43bd-85fe-5111d16db374 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:33.952225 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-907f004a-108c-43bd-85fe-5111d16db374 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:33.952879 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-907f004a-108c-43bd-85fe-5111d16db374 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:33.953732 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-907f004a-108c-43bd-85fe-5111d16db374 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:33.954342 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-907f004a-108c-43bd-85fe-5111d16db374 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:33.954924 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-907f004a-108c-43bd-85fe-5111d16db374 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:34.084371 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-907f004a-108c-43bd-85fe-5111d16db374 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:34.092193 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-907f004a-108c-43bd-85fe-5111d16db374 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1568 microversion: 2.1 time: 0.153364 Aug 24 03:38:34.093046 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 414/816] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:33 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:35.113630 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-821d35be-70e9-404e-b252-7a3851c12a97 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:35.114252 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-821d35be-70e9-404e-b252-7a3851c12a97 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:35.120634 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-821d35be-70e9-404e-b252-7a3851c12a97 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:35.121040 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-821d35be-70e9-404e-b252-7a3851c12a97 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:35.121483 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-821d35be-70e9-404e-b252-7a3851c12a97 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:35.122178 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-821d35be-70e9-404e-b252-7a3851c12a97 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:35.122638 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-821d35be-70e9-404e-b252-7a3851c12a97 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:35.123091 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-821d35be-70e9-404e-b252-7a3851c12a97 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:35.258314 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-821d35be-70e9-404e-b252-7a3851c12a97 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:35.266708 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-821d35be-70e9-404e-b252-7a3851c12a97 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1568 microversion: 2.1 time: 0.156928 Aug 24 03:38:35.267270 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 403/817] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:35 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:36.288917 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-cbfb6e25-208d-40ea-bff1-466244eecd0b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:36.289637 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-cbfb6e25-208d-40ea-bff1-466244eecd0b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:36.299755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cbfb6e25-208d-40ea-bff1-466244eecd0b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:36.300650 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cbfb6e25-208d-40ea-bff1-466244eecd0b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:36.301454 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cbfb6e25-208d-40ea-bff1-466244eecd0b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:36.302237 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cbfb6e25-208d-40ea-bff1-466244eecd0b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:36.302765 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cbfb6e25-208d-40ea-bff1-466244eecd0b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:36.303285 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cbfb6e25-208d-40ea-bff1-466244eecd0b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:36.435471 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-cbfb6e25-208d-40ea-bff1-466244eecd0b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:36.443685 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-cbfb6e25-208d-40ea-bff1-466244eecd0b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1568 microversion: 2.1 time: 0.159405 Aug 24 03:38:36.444258 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 415/818] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:36 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:37.466734 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d33245be-c3cb-4cde-a863-53e43fa5730e tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:37.467306 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d33245be-c3cb-4cde-a863-53e43fa5730e tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:37.473955 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d33245be-c3cb-4cde-a863-53e43fa5730e tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:37.474440 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d33245be-c3cb-4cde-a863-53e43fa5730e tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:37.474875 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d33245be-c3cb-4cde-a863-53e43fa5730e tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:37.475559 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d33245be-c3cb-4cde-a863-53e43fa5730e tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:37.476012 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d33245be-c3cb-4cde-a863-53e43fa5730e tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:37.476435 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d33245be-c3cb-4cde-a863-53e43fa5730e tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:37.607327 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-d33245be-c3cb-4cde-a863-53e43fa5730e tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:37.615016 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d33245be-c3cb-4cde-a863-53e43fa5730e tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1568 microversion: 2.1 time: 0.153255 Aug 24 03:38:37.615581 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 404/819] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:37 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:38.636034 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-40723a10-8ef1-4cff-84bb-49466a865d27 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:38.637076 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-40723a10-8ef1-4cff-84bb-49466a865d27 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:38.643639 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-40723a10-8ef1-4cff-84bb-49466a865d27 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:38.644138 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-40723a10-8ef1-4cff-84bb-49466a865d27 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:38.644612 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-40723a10-8ef1-4cff-84bb-49466a865d27 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:38.645376 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-40723a10-8ef1-4cff-84bb-49466a865d27 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:38.645867 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-40723a10-8ef1-4cff-84bb-49466a865d27 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:38.646295 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-40723a10-8ef1-4cff-84bb-49466a865d27 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:38.785488 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-40723a10-8ef1-4cff-84bb-49466a865d27 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:38.794870 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-40723a10-8ef1-4cff-84bb-49466a865d27 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1568 microversion: 2.1 time: 0.162659 Aug 24 03:38:38.795450 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 416/820] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:38 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:39.816507 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ea986071-185c-478a-af86-6860210e0a94 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:39.817126 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ea986071-185c-478a-af86-6860210e0a94 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:39.825504 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ea986071-185c-478a-af86-6860210e0a94 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:39.826157 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ea986071-185c-478a-af86-6860210e0a94 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:39.826621 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ea986071-185c-478a-af86-6860210e0a94 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:39.828287 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ea986071-185c-478a-af86-6860210e0a94 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:39.828842 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ea986071-185c-478a-af86-6860210e0a94 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:39.829403 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ea986071-185c-478a-af86-6860210e0a94 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:39.963898 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ea986071-185c-478a-af86-6860210e0a94 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:39.972702 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ea986071-185c-478a-af86-6860210e0a94 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1509 microversion: 2.1 time: 0.160102 Aug 24 03:38:39.973353 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 405/821] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:39 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:39.993434 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-38abe436-e142-46a0-b724-bc67908257a5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:39.994032 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-38abe436-e142-46a0-b724-bc67908257a5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:40.000545 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-38abe436-e142-46a0-b724-bc67908257a5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:40.001088 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-38abe436-e142-46a0-b724-bc67908257a5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:40.001530 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-38abe436-e142-46a0-b724-bc67908257a5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:40.002210 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-38abe436-e142-46a0-b724-bc67908257a5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:40.002665 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-38abe436-e142-46a0-b724-bc67908257a5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:40.003085 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-38abe436-e142-46a0-b724-bc67908257a5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:40.031699 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-38abe436-e142-46a0-b724-bc67908257a5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120709) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 03:38:40.095482 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-38abe436-e142-46a0-b724-bc67908257a5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "POST /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508/action" status: 202 len: 0 microversion: 2.1 time: 0.105723 Aug 24 03:38:40.095999 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 417/822] 10.222.0.81 () {60 vars in 1278 bytes} [Wed Aug 24 03:38:39 2022] POST /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:38:40.104095 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1f36a065-94cd-4609-b4a7-8e1b10066230 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:40.104744 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1f36a065-94cd-4609-b4a7-8e1b10066230 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:40.111585 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1f36a065-94cd-4609-b4a7-8e1b10066230 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:40.112071 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1f36a065-94cd-4609-b4a7-8e1b10066230 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:40.112511 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1f36a065-94cd-4609-b4a7-8e1b10066230 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:40.113240 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1f36a065-94cd-4609-b4a7-8e1b10066230 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:40.113694 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1f36a065-94cd-4609-b4a7-8e1b10066230 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:40.114119 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1f36a065-94cd-4609-b4a7-8e1b10066230 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:40.305175 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1f36a065-94cd-4609-b4a7-8e1b10066230 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:40.313068 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1f36a065-94cd-4609-b4a7-8e1b10066230 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1517 microversion: 2.1 time: 0.212885 Aug 24 03:38:40.313631 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 406/823] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:40 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1517 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:41.335802 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-65e5ae64-794a-4034-8212-87ef73d8c537 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:41.336370 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-65e5ae64-794a-4034-8212-87ef73d8c537 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:41.343367 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-65e5ae64-794a-4034-8212-87ef73d8c537 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:41.343850 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-65e5ae64-794a-4034-8212-87ef73d8c537 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:41.344294 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-65e5ae64-794a-4034-8212-87ef73d8c537 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:41.345010 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-65e5ae64-794a-4034-8212-87ef73d8c537 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:41.345470 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-65e5ae64-794a-4034-8212-87ef73d8c537 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:41.345899 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-65e5ae64-794a-4034-8212-87ef73d8c537 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:41.477843 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-65e5ae64-794a-4034-8212-87ef73d8c537 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:41.486941 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-65e5ae64-794a-4034-8212-87ef73d8c537 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1517 microversion: 2.1 time: 0.155106 Aug 24 03:38:41.487512 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 418/824] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:41 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:42.509318 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4e956dff-0617-4b01-8875-43f0b4c47400 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:42.509941 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-4e956dff-0617-4b01-8875-43f0b4c47400 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:42.517068 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4e956dff-0617-4b01-8875-43f0b4c47400 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:42.517561 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4e956dff-0617-4b01-8875-43f0b4c47400 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:42.518002 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4e956dff-0617-4b01-8875-43f0b4c47400 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:42.518694 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4e956dff-0617-4b01-8875-43f0b4c47400 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:42.519153 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4e956dff-0617-4b01-8875-43f0b4c47400 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:42.519581 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4e956dff-0617-4b01-8875-43f0b4c47400 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:42.657591 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4e956dff-0617-4b01-8875-43f0b4c47400 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:42.665742 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4e956dff-0617-4b01-8875-43f0b4c47400 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1517 microversion: 2.1 time: 0.160244 Aug 24 03:38:42.666617 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 407/825] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:42 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:42.715121 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-f6f74691-5638-47aa-bcd5-aff4685af0fd req-66c0e53d-f3d6-47e0-93cf-85f395cb944c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee318a0-695b-431d-98cc-0d21560a2508", "name": "network-vif-unplugged", "status": "completed", "tag": "b8c721ca-e1f1-4111-b00e-57a5d43c8885"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:42.729767 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-f6f74691-5638-47aa-bcd5-aff4685af0fd req-66c0e53d-f3d6-47e0-93cf-85f395cb944c service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:42.730329 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-f6f74691-5638-47aa-bcd5-aff4685af0fd req-66c0e53d-f3d6-47e0-93cf-85f395cb944c service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:42.730866 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-f6f74691-5638-47aa-bcd5-aff4685af0fd req-66c0e53d-f3d6-47e0-93cf-85f395cb944c service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:42.746099 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.compute.server_external_events [req-f6f74691-5638-47aa-bcd5-aff4685af0fd req-66c0e53d-f3d6-47e0-93cf-85f395cb944c service nova] Unable to find a host for instance 7ee318a0-695b-431d-98cc-0d21560a2508. Dropping event network-vif-unplugged {{(pid=120709) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 03:38:42.747682 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-f6f74691-5638-47aa-bcd5-aff4685af0fd req-66c0e53d-f3d6-47e0-93cf-85f395cb944c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036078 Aug 24 03:38:42.748952 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 419/826] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 03:38:43.687591 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-3ea77a9f-5d13-450b-a206-3ce633b7d7ab tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:43.688206 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-3ea77a9f-5d13-450b-a206-3ce633b7d7ab tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:43.694823 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3ea77a9f-5d13-450b-a206-3ce633b7d7ab tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:43.695309 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3ea77a9f-5d13-450b-a206-3ce633b7d7ab tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:43.695745 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3ea77a9f-5d13-450b-a206-3ce633b7d7ab tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:43.696440 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3ea77a9f-5d13-450b-a206-3ce633b7d7ab tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:43.696920 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3ea77a9f-5d13-450b-a206-3ce633b7d7ab tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:43.697343 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3ea77a9f-5d13-450b-a206-3ce633b7d7ab tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:43.832389 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-3ea77a9f-5d13-450b-a206-3ce633b7d7ab tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:43.840333 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-3ea77a9f-5d13-450b-a206-3ce633b7d7ab tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1575 microversion: 2.1 time: 0.156729 Aug 24 03:38:43.842366 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 408/827] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:43 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:44.865216 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-071a6cd9-2c3f-456b-b6c6-173267721daf tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:44.865845 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-071a6cd9-2c3f-456b-b6c6-173267721daf tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:44.873165 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-071a6cd9-2c3f-456b-b6c6-173267721daf tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:44.873658 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-071a6cd9-2c3f-456b-b6c6-173267721daf tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:44.874102 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-071a6cd9-2c3f-456b-b6c6-173267721daf tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:44.874804 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-071a6cd9-2c3f-456b-b6c6-173267721daf tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:44.875261 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-071a6cd9-2c3f-456b-b6c6-173267721daf tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:44.875686 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-071a6cd9-2c3f-456b-b6c6-173267721daf tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:44.893329 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:45.011760 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-071a6cd9-2c3f-456b-b6c6-173267721daf tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:45.019378 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-071a6cd9-2c3f-456b-b6c6-173267721daf tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1575 microversion: 2.1 time: 0.158012 Aug 24 03:38:45.020104 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 420/828] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:44 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:46.041147 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-bdac2e84-380d-4059-9348-56689ef241c7 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:46.041800 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-bdac2e84-380d-4059-9348-56689ef241c7 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:46.048789 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bdac2e84-380d-4059-9348-56689ef241c7 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:46.049283 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bdac2e84-380d-4059-9348-56689ef241c7 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:46.049717 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bdac2e84-380d-4059-9348-56689ef241c7 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:46.050403 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bdac2e84-380d-4059-9348-56689ef241c7 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:46.050856 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bdac2e84-380d-4059-9348-56689ef241c7 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:46.051281 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bdac2e84-380d-4059-9348-56689ef241c7 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:46.180878 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-bdac2e84-380d-4059-9348-56689ef241c7 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:46.188990 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-bdac2e84-380d-4059-9348-56689ef241c7 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1575 microversion: 2.1 time: 0.151796 Aug 24 03:38:46.189554 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 409/829] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:46 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:47.210453 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-b72d573c-427b-4d9b-a354-1ba7568f5b5b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:47.211051 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-b72d573c-427b-4d9b-a354-1ba7568f5b5b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:47.217509 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b72d573c-427b-4d9b-a354-1ba7568f5b5b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:47.218322 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b72d573c-427b-4d9b-a354-1ba7568f5b5b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:47.218789 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b72d573c-427b-4d9b-a354-1ba7568f5b5b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:47.219514 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b72d573c-427b-4d9b-a354-1ba7568f5b5b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:47.219969 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b72d573c-427b-4d9b-a354-1ba7568f5b5b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:47.220395 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b72d573c-427b-4d9b-a354-1ba7568f5b5b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:47.357686 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-b72d573c-427b-4d9b-a354-1ba7568f5b5b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:47.367430 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-b72d573c-427b-4d9b-a354-1ba7568f5b5b tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1575 microversion: 2.1 time: 0.160932 Aug 24 03:38:47.367924 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 421/830] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:47 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:48.391242 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-86cf3b54-fb0e-459d-8dd2-2c0f352052b0 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:48.393008 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-86cf3b54-fb0e-459d-8dd2-2c0f352052b0 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:48.400677 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-86cf3b54-fb0e-459d-8dd2-2c0f352052b0 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:48.401235 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-86cf3b54-fb0e-459d-8dd2-2c0f352052b0 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:48.401722 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-86cf3b54-fb0e-459d-8dd2-2c0f352052b0 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:48.402429 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-86cf3b54-fb0e-459d-8dd2-2c0f352052b0 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:48.402945 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-86cf3b54-fb0e-459d-8dd2-2c0f352052b0 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:48.403374 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-86cf3b54-fb0e-459d-8dd2-2c0f352052b0 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:48.535460 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-86cf3b54-fb0e-459d-8dd2-2c0f352052b0 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:48.543115 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-86cf3b54-fb0e-459d-8dd2-2c0f352052b0 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1575 microversion: 2.1 time: 0.157217 Aug 24 03:38:48.543671 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 410/831] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:48 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:49.111145 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-eb7287d4-e95e-46b6-81ca-f27e930bef60 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:49.111717 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-eb7287d4-e95e-46b6-81ca-f27e930bef60 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 3a493863-6fda-4311-8271-48f093698726] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:49.118019 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-eb7287d4-e95e-46b6-81ca-f27e930bef60 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:49.118504 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-eb7287d4-e95e-46b6-81ca-f27e930bef60 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:49.118944 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-eb7287d4-e95e-46b6-81ca-f27e930bef60 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:49.119633 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-eb7287d4-e95e-46b6-81ca-f27e930bef60 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:49.120092 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-eb7287d4-e95e-46b6-81ca-f27e930bef60 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:49.120524 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-eb7287d4-e95e-46b6-81ca-f27e930bef60 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:49.143543 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-eb7287d4-e95e-46b6-81ca-f27e930bef60 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726/ips" status: 200 len: 149 microversion: 2.1 time: 0.036426 Aug 24 03:38:49.144122 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 422/832] 10.222.0.81 () {58 vars in 1248 bytes} [Wed Aug 24 03:38:49 2022] GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:49.565324 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a4a96e7a-ec7f-4b68-b6a0-aefcc8c356bc tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:49.565932 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a4a96e7a-ec7f-4b68-b6a0-aefcc8c356bc tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:49.572245 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a4a96e7a-ec7f-4b68-b6a0-aefcc8c356bc tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:49.572724 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a4a96e7a-ec7f-4b68-b6a0-aefcc8c356bc tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:49.573199 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a4a96e7a-ec7f-4b68-b6a0-aefcc8c356bc tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:49.573895 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a4a96e7a-ec7f-4b68-b6a0-aefcc8c356bc tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:49.574344 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a4a96e7a-ec7f-4b68-b6a0-aefcc8c356bc tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:49.574766 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a4a96e7a-ec7f-4b68-b6a0-aefcc8c356bc tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:49.707823 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a4a96e7a-ec7f-4b68-b6a0-aefcc8c356bc tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:49.715585 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a4a96e7a-ec7f-4b68-b6a0-aefcc8c356bc tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1575 microversion: 2.1 time: 0.155179 Aug 24 03:38:49.716146 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 411/833] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:49 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:50.365808 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-6895456a-3de9-4913-94a5-78f404de7904 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:50.366300 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-6895456a-3de9-4913-94a5-78f404de7904 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: f0b99435-b9be-4877-aabe-7ce35db35517] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:50.368662 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:50.374812 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6895456a-3de9-4913-94a5-78f404de7904 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:50.375300 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6895456a-3de9-4913-94a5-78f404de7904 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:50.375738 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6895456a-3de9-4913-94a5-78f404de7904 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:50.376428 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6895456a-3de9-4913-94a5-78f404de7904 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:50.376919 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6895456a-3de9-4913-94a5-78f404de7904 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:50.377349 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-6895456a-3de9-4913-94a5-78f404de7904 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:50.463814 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.objects.instance [None req-6895456a-3de9-4913-94a5-78f404de7904 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lazy-loading 'services' on Instance uuid f0b99435-b9be-4877-aabe-7ce35db35517 {{(pid=120709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:38:50.519994 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-16712d98-428b-4c87-9337-8a0e1037097a tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d5db7a4-7446-4dc4-a573-c369df523b6d"}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:50.522548 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-16712d98-428b-4c87-9337-8a0e1037097a tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 3a493863-6fda-4311-8271-48f093698726] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:50.528965 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-16712d98-428b-4c87-9337-8a0e1037097a tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:50.529462 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-16712d98-428b-4c87-9337-8a0e1037097a tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:50.530135 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-16712d98-428b-4c87-9337-8a0e1037097a tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:50.531800 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-16712d98-428b-4c87-9337-8a0e1037097a tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:50.532334 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-16712d98-428b-4c87-9337-8a0e1037097a tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:50.532807 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-16712d98-428b-4c87-9337-8a0e1037097a tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:50.546978 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-6895456a-3de9-4913-94a5-78f404de7904 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] 10.222.0.81 "DELETE /compute/v2.1/servers/f0b99435-b9be-4877-aabe-7ce35db35517/os-volume_attachments/f709d393-af9a-4d8e-b0ce-a8a34d6a9b7b" status: 202 len: 0 microversion: 2.1 time: 0.184869 Aug 24 03:38:50.547818 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 423/834] 10.222.0.81 () {58 vars in 1416 bytes} [Wed Aug 24 03:38:50 2022] DELETE /compute/v2.1/servers/f0b99435-b9be-4877-aabe-7ce35db35517/os-volume_attachments/f709d393-af9a-4d8e-b0ce-a8a34d6a9b7b => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:38:50.737717 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-90c468bd-1c2b-4f5c-89cc-fbf7ad9f7fa5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:50.738451 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-90c468bd-1c2b-4f5c-89cc-fbf7ad9f7fa5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:50.744458 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-90c468bd-1c2b-4f5c-89cc-fbf7ad9f7fa5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:50.744986 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-90c468bd-1c2b-4f5c-89cc-fbf7ad9f7fa5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:50.745424 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-90c468bd-1c2b-4f5c-89cc-fbf7ad9f7fa5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:50.746102 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-90c468bd-1c2b-4f5c-89cc-fbf7ad9f7fa5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:50.746552 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-90c468bd-1c2b-4f5c-89cc-fbf7ad9f7fa5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:50.746970 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-90c468bd-1c2b-4f5c-89cc-fbf7ad9f7fa5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:50.877787 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-90c468bd-1c2b-4f5c-89cc-fbf7ad9f7fa5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:50.885639 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-90c468bd-1c2b-4f5c-89cc-fbf7ad9f7fa5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1575 microversion: 2.1 time: 0.152072 Aug 24 03:38:50.886205 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 424/835] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:50 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:51.101259 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-16712d98-428b-4c87-9337-8a0e1037097a tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "POST /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.585588 Aug 24 03:38:51.101894 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 412/836] 10.222.0.81 () {60 vars in 1323 bytes} [Wed Aug 24 03:38:50 2022] POST /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726/os-volume_attachments => generated 194 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:38:51.670589 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-62dcfbd1-2428-4854-910a-a6adbdecde5a tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:51.671812 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-62dcfbd1-2428-4854-910a-a6adbdecde5a tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: f0b99435-b9be-4877-aabe-7ce35db35517] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:51.678077 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-62dcfbd1-2428-4854-910a-a6adbdecde5a tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:51.678558 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-62dcfbd1-2428-4854-910a-a6adbdecde5a tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:51.678990 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-62dcfbd1-2428-4854-910a-a6adbdecde5a tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:51.679667 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-62dcfbd1-2428-4854-910a-a6adbdecde5a tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:51.680116 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-62dcfbd1-2428-4854-910a-a6adbdecde5a tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:51.680529 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-62dcfbd1-2428-4854-910a-a6adbdecde5a tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:51.704922 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-62dcfbd1-2428-4854-910a-a6adbdecde5a tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: f0b99435-b9be-4877-aabe-7ce35db35517] Going to try to terminate instance {{(pid=120709) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:38:51.783037 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-62dcfbd1-2428-4854-910a-a6adbdecde5a tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] 10.222.0.81 "DELETE /compute/v2.1/servers/f0b99435-b9be-4877-aabe-7ce35db35517" status: 204 len: 0 microversion: 2.1 time: 0.115872 Aug 24 03:38:51.783653 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 425/837] 10.222.0.81 () {58 vars in 1239 bytes} [Wed Aug 24 03:38:51 2022] DELETE /compute/v2.1/servers/f0b99435-b9be-4877-aabe-7ce35db35517 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:38:51.793212 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-54ed431c-a58b-47eb-b13f-8fd95b74d183 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:51.793910 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-54ed431c-a58b-47eb-b13f-8fd95b74d183 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: f0b99435-b9be-4877-aabe-7ce35db35517] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:51.800675 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-54ed431c-a58b-47eb-b13f-8fd95b74d183 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:51.801197 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-54ed431c-a58b-47eb-b13f-8fd95b74d183 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:51.801628 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-54ed431c-a58b-47eb-b13f-8fd95b74d183 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:51.802315 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-54ed431c-a58b-47eb-b13f-8fd95b74d183 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:51.802763 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-54ed431c-a58b-47eb-b13f-8fd95b74d183 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:51.803181 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-54ed431c-a58b-47eb-b13f-8fd95b74d183 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:51.908289 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-abbcd837-6feb-49d0-aa03-e09d0c76c946 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:51.909621 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-abbcd837-6feb-49d0-aa03-e09d0c76c946 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:51.915448 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-abbcd837-6feb-49d0-aa03-e09d0c76c946 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:51.915918 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-abbcd837-6feb-49d0-aa03-e09d0c76c946 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:51.916366 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-abbcd837-6feb-49d0-aa03-e09d0c76c946 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:51.917109 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-abbcd837-6feb-49d0-aa03-e09d0c76c946 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:51.917571 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-abbcd837-6feb-49d0-aa03-e09d0c76c946 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:51.918000 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-abbcd837-6feb-49d0-aa03-e09d0c76c946 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:51.935807 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-54ed431c-a58b-47eb-b13f-8fd95b74d183 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5143313cddbb4f56bf48d84167069c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f494a609f241328d85790280b204b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:51.943795 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-54ed431c-a58b-47eb-b13f-8fd95b74d183 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] 10.222.0.81 "GET /compute/v2.1/servers/f0b99435-b9be-4877-aabe-7ce35db35517" status: 200 len: 1513 microversion: 2.1 time: 0.155197 Aug 24 03:38:51.944371 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 413/838] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:51 2022] GET /compute/v2.1/servers/f0b99435-b9be-4877-aabe-7ce35db35517 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:52.061573 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-abbcd837-6feb-49d0-aa03-e09d0c76c946 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:52.069278 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-abbcd837-6feb-49d0-aa03-e09d0c76c946 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1575 microversion: 2.1 time: 0.165938 Aug 24 03:38:52.069840 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 426/839] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:51 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:52.966574 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-9369c526-9e46-4e90-a21e-48bd4d734b34 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:52.967192 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-9369c526-9e46-4e90-a21e-48bd4d734b34 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: f0b99435-b9be-4877-aabe-7ce35db35517] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:52.973932 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9369c526-9e46-4e90-a21e-48bd4d734b34 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:52.974418 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9369c526-9e46-4e90-a21e-48bd4d734b34 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:52.974858 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9369c526-9e46-4e90-a21e-48bd4d734b34 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:52.975555 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9369c526-9e46-4e90-a21e-48bd4d734b34 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:52.976012 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9369c526-9e46-4e90-a21e-48bd4d734b34 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:52.976444 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9369c526-9e46-4e90-a21e-48bd4d734b34 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:52.994886 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:38:53.090553 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-2ae4c04d-962b-47d9-adf2-a3d29bd9e931 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:53.091193 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-2ae4c04d-962b-47d9-adf2-a3d29bd9e931 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:53.098866 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2ae4c04d-962b-47d9-adf2-a3d29bd9e931 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:53.099354 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2ae4c04d-962b-47d9-adf2-a3d29bd9e931 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:53.099801 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2ae4c04d-962b-47d9-adf2-a3d29bd9e931 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:53.100491 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2ae4c04d-962b-47d9-adf2-a3d29bd9e931 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:53.100982 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2ae4c04d-962b-47d9-adf2-a3d29bd9e931 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:53.101411 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2ae4c04d-962b-47d9-adf2-a3d29bd9e931 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:53.110661 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-9369c526-9e46-4e90-a21e-48bd4d734b34 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5143313cddbb4f56bf48d84167069c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f494a609f241328d85790280b204b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:53.118673 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-9369c526-9e46-4e90-a21e-48bd4d734b34 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] 10.222.0.81 "GET /compute/v2.1/servers/f0b99435-b9be-4877-aabe-7ce35db35517" status: 200 len: 1513 microversion: 2.1 time: 0.156225 Aug 24 03:38:53.119240 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 414/840] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:52 2022] GET /compute/v2.1/servers/f0b99435-b9be-4877-aabe-7ce35db35517 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:53.234601 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-2ae4c04d-962b-47d9-adf2-a3d29bd9e931 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:53.242147 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-2ae4c04d-962b-47d9-adf2-a3d29bd9e931 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1575 microversion: 2.1 time: 0.155378 Aug 24 03:38:53.242705 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 427/841] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:53 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:54.140342 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1278d6ed-120f-4d5d-b271-36d845e15076 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:54.141006 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1278d6ed-120f-4d5d-b271-36d845e15076 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: f0b99435-b9be-4877-aabe-7ce35db35517] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:54.147528 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1278d6ed-120f-4d5d-b271-36d845e15076 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:54.148014 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1278d6ed-120f-4d5d-b271-36d845e15076 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:54.148451 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1278d6ed-120f-4d5d-b271-36d845e15076 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:54.149169 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1278d6ed-120f-4d5d-b271-36d845e15076 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:54.149626 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1278d6ed-120f-4d5d-b271-36d845e15076 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:54.150299 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1278d6ed-120f-4d5d-b271-36d845e15076 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:54.265082 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-8e5bbf3e-903d-48a8-9d72-37227504a102 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:54.266318 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-8e5bbf3e-903d-48a8-9d72-37227504a102 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:54.273295 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8e5bbf3e-903d-48a8-9d72-37227504a102 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:54.274030 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8e5bbf3e-903d-48a8-9d72-37227504a102 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:54.274647 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8e5bbf3e-903d-48a8-9d72-37227504a102 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:54.275362 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8e5bbf3e-903d-48a8-9d72-37227504a102 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:54.276132 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8e5bbf3e-903d-48a8-9d72-37227504a102 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:54.276568 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8e5bbf3e-903d-48a8-9d72-37227504a102 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:54.282576 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1278d6ed-120f-4d5d-b271-36d845e15076 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5143313cddbb4f56bf48d84167069c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69f494a609f241328d85790280b204b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:54.291358 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1278d6ed-120f-4d5d-b271-36d845e15076 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] 10.222.0.81 "GET /compute/v2.1/servers/f0b99435-b9be-4877-aabe-7ce35db35517" status: 200 len: 1513 microversion: 2.1 time: 0.155899 Aug 24 03:38:54.292238 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 415/842] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:54 2022] GET /compute/v2.1/servers/f0b99435-b9be-4877-aabe-7ce35db35517 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:54.416115 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-8e5bbf3e-903d-48a8-9d72-37227504a102 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:54.424677 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-8e5bbf3e-903d-48a8-9d72-37227504a102 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1575 microversion: 2.1 time: 0.164053 Aug 24 03:38:54.425296 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 428/843] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:54 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:54.732830 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-7459563d-c608-467e-be58-982f571aed02 req-638ea8de-f527-4e68-8f55-e21efdfdef36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0b99435-b9be-4877-aabe-7ce35db35517", "name": "network-vif-deleted", "tag": "44487cab-e8cf-4744-ae9d-f6bf08586370"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:54.744179 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-7459563d-c608-467e-be58-982f571aed02 req-638ea8de-f527-4e68-8f55-e21efdfdef36 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:54.744805 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-7459563d-c608-467e-be58-982f571aed02 req-638ea8de-f527-4e68-8f55-e21efdfdef36 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:54.745247 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-7459563d-c608-467e-be58-982f571aed02 req-638ea8de-f527-4e68-8f55-e21efdfdef36 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:54.756825 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-7459563d-c608-467e-be58-982f571aed02 req-638ea8de-f527-4e68-8f55-e21efdfdef36 service nova] Creating event network-vif-deleted:44487cab-e8cf-4744-ae9d-f6bf08586370 for instance f0b99435-b9be-4877-aabe-7ce35db35517 on hv-cinder-85426 Aug 24 03:38:54.762023 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-7459563d-c608-467e-be58-982f571aed02 req-638ea8de-f527-4e68-8f55-e21efdfdef36 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032888 Aug 24 03:38:54.762643 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 416/844] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:38:55.313013 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-1560e5c8-c8f9-4908-863f-35cea7ddfae3 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:55.313648 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-1560e5c8-c8f9-4908-863f-35cea7ddfae3 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] [instance: f0b99435-b9be-4877-aabe-7ce35db35517] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:55.319979 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1560e5c8-c8f9-4908-863f-35cea7ddfae3 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:55.320484 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1560e5c8-c8f9-4908-863f-35cea7ddfae3 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:55.320964 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1560e5c8-c8f9-4908-863f-35cea7ddfae3 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:55.321645 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1560e5c8-c8f9-4908-863f-35cea7ddfae3 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:55.322096 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1560e5c8-c8f9-4908-863f-35cea7ddfae3 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:55.322514 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1560e5c8-c8f9-4908-863f-35cea7ddfae3 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:55.336653 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.wsgi [None req-1560e5c8-c8f9-4908-863f-35cea7ddfae3 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] HTTP exception thrown: Instance f0b99435-b9be-4877-aabe-7ce35db35517 could not be found. Aug 24 03:38:55.338297 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-1560e5c8-c8f9-4908-863f-35cea7ddfae3 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Request method failure captured: Aug 24 03:38:55.338297 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: request: GET /compute/v2.1/servers/f0b99435-b9be-4877-aabe-7ce35db35517 HTTP/1.1 Aug 24 03:38:55.338297 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept: application/json Aug 24 03:38:55.338297 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept-Encoding: identity Aug 24 03:38:55.338297 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Connection: close Aug 24 03:38:55.338297 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Length: 0 Aug 24 03:38:55.338297 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Type: application/json Aug 24 03:38:55.338297 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Host: 10.222.0.81 Aug 24 03:38:55.338297 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Openstack-System-Scope: None Aug 24 03:38:55.338297 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: User-Agent: python-urllib3/1.26.11 Aug 24 03:38:55.338297 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Auth-Token: gAAAAABjBZzrvCyuHlmzjPDuz_RWZQzynoBIqLD82Y6oNoUwUcqx5svurxN4uug-JonRuhfLWT7gkzLphMOUYUPK_Pp_-d7gP6l9_fu_HbsKnqkBWu3IGnrboA4Pdt9-mbUHQ40oUeiWbcebo1rxppWK45pIHfrS18kJPEgv1Cipzz00O_i28w8 Aug 24 03:38:55.338297 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Id: None Aug 24 03:38:55.338297 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Name: None Aug 24 03:38:55.338297 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Identity-Status: Confirmed Aug 24 03:38:55.338297 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Is-Admin-Project: True Aug 24 03:38:55.338297 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Id: default Aug 24 03:38:55.338297 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Name: Default Aug 24 03:38:55.338297 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Id: 69f494a609f241328d85790280b204b8 Aug 24 03:38:55.338297 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Name: tempest-VolumesSnapshotTestJSON-707471405 Aug 24 03:38:55.338297 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Role: reader,member Aug 24 03:38:55.338297 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Roles: reader,member Aug 24 03:38:55.339666 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/69f494a609f241328d85790280b204b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_69f494a609f241328d85790280b204b8", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/69f494a609f241328d85790280b204b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/69f494a609f241328d85790280b204b8"}]}] Aug 24 03:38:55.339666 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant: tempest-VolumesSnapshotTestJSON-707471405 Aug 24 03:38:55.339666 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Id: 69f494a609f241328d85790280b204b8 Aug 24 03:38:55.339666 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-707471405 Aug 24 03:38:55.339666 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User: tempest-VolumesSnapshotTestJSON-707471405-project Aug 24 03:38:55.339666 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Id: default Aug 24 03:38:55.339666 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Name: Default Aug 24 03:38:55.339666 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Id: 5143313cddbb4f56bf48d84167069c74 Aug 24 03:38:55.339666 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Name: tempest-VolumesSnapshotTestJSON-707471405-project Aug 24 03:38:55.339666 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: method: > Aug 24 03:38:55.339666 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: exception: Instance f0b99435-b9be-4877-aabe-7ce35db35517 could not be found. Aug 24 03:38:55.339666 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: action_args: {'id': 'f0b99435-b9be-4877-aabe-7ce35db35517'} Aug 24 03:38:55.340452 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:38:55.340452 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:55.340452 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:38:55.340452 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:38:55.340452 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:38:55.340452 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:38:55.340452 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:38:55.340452 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:38:55.340452 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:38:55.340452 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:38:55.340452 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0b99435-b9be-4877-aabe-7ce35db35517 could not be found. Aug 24 03:38:55.340452 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:38:55.340452 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:55.340452 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:38:55.340452 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:55.340452 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:55.340452 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:55.340452 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:38:55.340452 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:38:55.340452 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:38:55.342091 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:38:55.342091 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:38:55.342091 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:38:55.342091 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:38:55.342091 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:38:55.342091 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:38:55.342091 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:38:55.342091 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0b99435-b9be-4877-aabe-7ce35db35517 could not be found. Aug 24 03:38:55.342091 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:38:55.342091 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:38:55.342091 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:38:55.342091 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:38:55.342091 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:38:55.342091 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:38:55.342091 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:38:55.342091 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:38:55.342091 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0b99435-b9be-4877-aabe-7ce35db35517 could not be found. Aug 24 03:38:55.342091 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:38:55.344714 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-1560e5c8-c8f9-4908-863f-35cea7ddfae3 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] Returning 404 to user: Instance f0b99435-b9be-4877-aabe-7ce35db35517 could not be found. {{(pid=120709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:38:55.344714 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-1560e5c8-c8f9-4908-863f-35cea7ddfae3 tempest-VolumesSnapshotTestJSON-707471405 tempest-VolumesSnapshotTestJSON-707471405-project] 10.222.0.81 "GET /compute/v2.1/servers/f0b99435-b9be-4877-aabe-7ce35db35517" status: 404 len: 111 microversion: 2.1 time: 0.030658 Aug 24 03:38:55.344714 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 429/845] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:55 2022] GET /compute/v2.1/servers/f0b99435-b9be-4877-aabe-7ce35db35517 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:38:55.447888 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7bb14790-f92d-45cb-9abf-7a01524ccdba tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:55.448931 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-7bb14790-f92d-45cb-9abf-7a01524ccdba tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:55.456609 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7bb14790-f92d-45cb-9abf-7a01524ccdba tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:55.457189 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7bb14790-f92d-45cb-9abf-7a01524ccdba tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:55.457637 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7bb14790-f92d-45cb-9abf-7a01524ccdba tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:55.458342 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7bb14790-f92d-45cb-9abf-7a01524ccdba tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:55.458801 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7bb14790-f92d-45cb-9abf-7a01524ccdba tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:55.459234 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7bb14790-f92d-45cb-9abf-7a01524ccdba tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:55.609665 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-7bb14790-f92d-45cb-9abf-7a01524ccdba tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:55.620863 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-7bb14790-f92d-45cb-9abf-7a01524ccdba tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1575 microversion: 2.1 time: 0.179170 Aug 24 03:38:55.621774 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 417/846] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:55 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1575 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:56.642079 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-e7c3f83e-79b2-42de-b722-d1e0b400dd30 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:56.642692 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-e7c3f83e-79b2-42de-b722-d1e0b400dd30 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:56.649218 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e7c3f83e-79b2-42de-b722-d1e0b400dd30 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:56.649712 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e7c3f83e-79b2-42de-b722-d1e0b400dd30 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:56.650151 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e7c3f83e-79b2-42de-b722-d1e0b400dd30 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:56.650852 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e7c3f83e-79b2-42de-b722-d1e0b400dd30 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:56.651308 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e7c3f83e-79b2-42de-b722-d1e0b400dd30 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:56.651738 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e7c3f83e-79b2-42de-b722-d1e0b400dd30 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:56.788686 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-e7c3f83e-79b2-42de-b722-d1e0b400dd30 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:56.798145 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-e7c3f83e-79b2-42de-b722-d1e0b400dd30 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1575 microversion: 2.1 time: 0.159909 Aug 24 03:38:56.798717 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 430/847] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:56 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:57.819138 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-3d0825bd-e843-48e5-9b99-d813c3e12722 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:57.819703 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-3d0825bd-e843-48e5-9b99-d813c3e12722 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:57.826091 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3d0825bd-e843-48e5-9b99-d813c3e12722 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:57.826573 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3d0825bd-e843-48e5-9b99-d813c3e12722 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:57.827148 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3d0825bd-e843-48e5-9b99-d813c3e12722 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:57.827862 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3d0825bd-e843-48e5-9b99-d813c3e12722 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:57.828317 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3d0825bd-e843-48e5-9b99-d813c3e12722 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:57.828742 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-3d0825bd-e843-48e5-9b99-d813c3e12722 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:57.966961 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-3d0825bd-e843-48e5-9b99-d813c3e12722 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:57.975829 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-3d0825bd-e843-48e5-9b99-d813c3e12722 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1575 microversion: 2.1 time: 0.160705 Aug 24 03:38:57.976392 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 418/848] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:57 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:58.997973 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-db864eee-9b40-4696-b50d-cf1589a46b4c tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:58.998915 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-db864eee-9b40-4696-b50d-cf1589a46b4c tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:59.008239 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-db864eee-9b40-4696-b50d-cf1589a46b4c tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:59.009005 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-db864eee-9b40-4696-b50d-cf1589a46b4c tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:59.009665 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-db864eee-9b40-4696-b50d-cf1589a46b4c tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:59.010702 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-db864eee-9b40-4696-b50d-cf1589a46b4c tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:59.011399 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-db864eee-9b40-4696-b50d-cf1589a46b4c tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:59.012047 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-db864eee-9b40-4696-b50d-cf1589a46b4c tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:59.142028 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-db864eee-9b40-4696-b50d-cf1589a46b4c tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:59.149586 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-db864eee-9b40-4696-b50d-cf1589a46b4c tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1575 microversion: 2.1 time: 0.156609 Aug 24 03:38:59.150189 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 431/849] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:58 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:38:59.750535 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-cdc8fb0f-77e0-48bb-b175-4c51bd3eeb2a req-8ecaae0c-9737-4390-8a15-0f6d74c0e612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee318a0-695b-431d-98cc-0d21560a2508", "name": "network-vif-plugged", "status": "completed", "tag": "b8c721ca-e1f1-4111-b00e-57a5d43c8885"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:38:59.760816 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-cdc8fb0f-77e0-48bb-b175-4c51bd3eeb2a req-8ecaae0c-9737-4390-8a15-0f6d74c0e612 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:59.761435 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-cdc8fb0f-77e0-48bb-b175-4c51bd3eeb2a req-8ecaae0c-9737-4390-8a15-0f6d74c0e612 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:59.762061 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-cdc8fb0f-77e0-48bb-b175-4c51bd3eeb2a req-8ecaae0c-9737-4390-8a15-0f6d74c0e612 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:59.773541 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-cdc8fb0f-77e0-48bb-b175-4c51bd3eeb2a req-8ecaae0c-9737-4390-8a15-0f6d74c0e612 service nova] Creating event network-vif-plugged:b8c721ca-e1f1-4111-b00e-57a5d43c8885 for instance 7ee318a0-695b-431d-98cc-0d21560a2508 on hv-cinder-85426 Aug 24 03:38:59.778587 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-cdc8fb0f-77e0-48bb-b175-4c51bd3eeb2a req-8ecaae0c-9737-4390-8a15-0f6d74c0e612 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032784 Aug 24 03:38:59.779317 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 419/850] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:00.170343 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-86decea9-5bfb-492c-aa49-e136e8982243 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:00.172286 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-86decea9-5bfb-492c-aa49-e136e8982243 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:00.178761 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-86decea9-5bfb-492c-aa49-e136e8982243 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:00.179255 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-86decea9-5bfb-492c-aa49-e136e8982243 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:00.179700 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-86decea9-5bfb-492c-aa49-e136e8982243 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:00.180403 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-86decea9-5bfb-492c-aa49-e136e8982243 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:00.180913 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-86decea9-5bfb-492c-aa49-e136e8982243 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:00.181345 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-86decea9-5bfb-492c-aa49-e136e8982243 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:00.329516 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-86decea9-5bfb-492c-aa49-e136e8982243 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:00.338365 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-86decea9-5bfb-492c-aa49-e136e8982243 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1575 microversion: 2.1 time: 0.171801 Aug 24 03:39:00.338936 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 432/851] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:00 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:00.764588 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4359a0d2-a18f-4262-aac1-1a2bf7fe1c3d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Action: 'create', calling method: .version_select at 0x7f94352a41f0>, body: {"keypair": {"name": "tempest-keypair-913596365", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONpWOF20D0KZLSJFt7GHOzaSNOm1xKISlK3JxmKrUE3hNV7V+RzJOrFvrG0YCzcPoHHXTagcI9oT9uDIMY9OFdrL+KLlkVnDDavYz3VUxggmWia4iLQLLnTaXTm3Z4RfA=="}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:00.779650 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-4359a0d2-a18f-4262-aac1-1a2bf7fe1c3d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Getting quotas for project 4b05b1de2f064ba29a6d0f7f4c8b2a01. Resources: {'key_pairs'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:39:00.784423 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-4359a0d2-a18f-4262-aac1-1a2bf7fe1c3d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Getting quotas for user e9fa457d74c644a3ad740da44576a12f and project 4b05b1de2f064ba29a6d0f7f4c8b2a01. Resources: {'key_pairs'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:39:00.806991 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4359a0d2-a18f-4262-aac1-1a2bf7fe1c3d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047177 Aug 24 03:39:00.807571 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 420/852] 10.222.0.81 () {60 vars in 1159 bytes} [Wed Aug 24 03:39:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:01.360396 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-5a591b5c-35ea-4af8-900e-21844e378184 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:01.361580 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-5a591b5c-35ea-4af8-900e-21844e378184 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:01.369570 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5a591b5c-35ea-4af8-900e-21844e378184 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:01.370057 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5a591b5c-35ea-4af8-900e-21844e378184 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:01.370494 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5a591b5c-35ea-4af8-900e-21844e378184 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:01.371193 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5a591b5c-35ea-4af8-900e-21844e378184 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:01.371646 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5a591b5c-35ea-4af8-900e-21844e378184 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:01.372072 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5a591b5c-35ea-4af8-900e-21844e378184 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:01.532656 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-5a591b5c-35ea-4af8-900e-21844e378184 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:01.541351 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-5a591b5c-35ea-4af8-900e-21844e378184 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1575 microversion: 2.1 time: 0.185580 Aug 24 03:39:01.542046 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 433/853] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:01 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1575 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:02.061153 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2c602302-0de2-4263-a4c1-de02327cdacf tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2016825808", "imageRef": "b7a40f0c-20c2-44cd-8b0e-f6e73a007d3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f7160365-682d-4059-86b5-916b47b99501"}], "security_groups": [{"name": "tempest-securitygroup--1816488947"}], "key_name": "tempest-keypair-913596365", "user_data": "}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:02.070279 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:02.168913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.network.neutron [None req-2c602302-0de2-4263-a4c1-de02327cdacf tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] validate_networks() for [('f7160365-682d-4059-86b5-916b47b99501', None, None, None, None, None)] {{(pid=120708) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:39:02.542402 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-2c602302-0de2-4263-a4c1-de02327cdacf tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Flavor limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:39:02.542970 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-2c602302-0de2-4263-a4c1-de02327cdacf tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Image limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:39:02.543573 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-2c602302-0de2-4263-a4c1-de02327cdacf tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Flavor pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:39:02.544094 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-2c602302-0de2-4263-a4c1-de02327cdacf tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Image pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:39:02.544940 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-2c602302-0de2-4263-a4c1-de02327cdacf tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:39:02.563917 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2c602302-0de2-4263-a4c1-de02327cdacf tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:02.564600 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2c602302-0de2-4263-a4c1-de02327cdacf tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:02.565144 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2c602302-0de2-4263-a4c1-de02327cdacf tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:02.565278 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-46dee66f-1e78-442b-9ee1-ec4caff940d5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:02.565823 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-46dee66f-1e78-442b-9ee1-ec4caff940d5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:02.565949 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2c602302-0de2-4263-a4c1-de02327cdacf tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:02.566302 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2c602302-0de2-4263-a4c1-de02327cdacf tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:02.566911 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2c602302-0de2-4263-a4c1-de02327cdacf tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:02.578359 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-46dee66f-1e78-442b-9ee1-ec4caff940d5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:02.578864 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-46dee66f-1e78-442b-9ee1-ec4caff940d5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:02.579308 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-46dee66f-1e78-442b-9ee1-ec4caff940d5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:02.580028 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-46dee66f-1e78-442b-9ee1-ec4caff940d5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:02.580489 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-46dee66f-1e78-442b-9ee1-ec4caff940d5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:02.580954 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-46dee66f-1e78-442b-9ee1-ec4caff940d5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:02.586912 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-2c602302-0de2-4263-a4c1-de02327cdacf tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Getting quotas for project 4b05b1de2f064ba29a6d0f7f4c8b2a01. Resources: {'ram', 'instances', 'cores'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:39:02.591095 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-2c602302-0de2-4263-a4c1-de02327cdacf tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Getting quotas for user e9fa457d74c644a3ad740da44576a12f and project 4b05b1de2f064ba29a6d0f7f4c8b2a01. Resources: {'ram', 'instances', 'cores'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:39:02.603207 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2c602302-0de2-4263-a4c1-de02327cdacf tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Going to run 1 instances... {{(pid=120708) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:39:02.605628 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2c602302-0de2-4263-a4c1-de02327cdacf tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: f97627fb-1853-4f70-a2be-00724183986c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b7a40f0c-20c2-44cd-8b0e-f6e73a007d3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120708) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:39:02.663133 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2c602302-0de2-4263-a4c1-de02327cdacf tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.606905 Aug 24 03:39:02.669447 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 421/854] 10.222.0.81 () {60 vars in 1147 bytes} [Wed Aug 24 03:39:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:39:02.675926 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-98d93103-03c4-4830-8ac2-6b3f2608132e tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:02.676556 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-98d93103-03c4-4830-8ac2-6b3f2608132e tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: f97627fb-1853-4f70-a2be-00724183986c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:02.761629 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-98d93103-03c4-4830-8ac2-6b3f2608132e tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:02.771436 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-98d93103-03c4-4830-8ac2-6b3f2608132e tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c" status: 200 len: 1241 microversion: 2.1 time: 0.100609 Aug 24 03:39:02.785079 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 422/855] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:02 2022] GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c => generated 1241 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:02.786826 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-46dee66f-1e78-442b-9ee1-ec4caff940d5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:02.795413 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-46dee66f-1e78-442b-9ee1-ec4caff940d5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1562 microversion: 2.1 time: 0.233990 Aug 24 03:39:02.797002 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 434/856] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:02 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1562 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:03.791537 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-9e9723ff-1ad0-43e1-86ef-08a5ae3e1994 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:03.792823 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-9e9723ff-1ad0-43e1-86ef-08a5ae3e1994 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: f97627fb-1853-4f70-a2be-00724183986c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:03.800070 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9e9723ff-1ad0-43e1-86ef-08a5ae3e1994 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:03.800829 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9e9723ff-1ad0-43e1-86ef-08a5ae3e1994 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:03.801435 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9e9723ff-1ad0-43e1-86ef-08a5ae3e1994 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:03.802559 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9e9723ff-1ad0-43e1-86ef-08a5ae3e1994 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:03.802754 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9e9723ff-1ad0-43e1-86ef-08a5ae3e1994 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:03.803349 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9e9723ff-1ad0-43e1-86ef-08a5ae3e1994 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:03.873614 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-9e9723ff-1ad0-43e1-86ef-08a5ae3e1994 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:03.882439 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-9e9723ff-1ad0-43e1-86ef-08a5ae3e1994 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c" status: 200 len: 1311 microversion: 2.1 time: 0.094753 Aug 24 03:39:03.883033 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 423/857] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:03 2022] GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:04.903389 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-e680a55e-9651-4dcb-a06d-d7d2c4b4ca6c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:04.904003 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-e680a55e-9651-4dcb-a06d-d7d2c4b4ca6c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: f97627fb-1853-4f70-a2be-00724183986c] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:04.912220 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e680a55e-9651-4dcb-a06d-d7d2c4b4ca6c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:04.912327 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e680a55e-9651-4dcb-a06d-d7d2c4b4ca6c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:04.912698 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e680a55e-9651-4dcb-a06d-d7d2c4b4ca6c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:04.913432 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e680a55e-9651-4dcb-a06d-d7d2c4b4ca6c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:04.913889 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e680a55e-9651-4dcb-a06d-d7d2c4b4ca6c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:04.914318 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e680a55e-9651-4dcb-a06d-d7d2c4b4ca6c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:05.045505 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-e680a55e-9651-4dcb-a06d-d7d2c4b4ca6c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:05.049194 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:05.054217 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-e680a55e-9651-4dcb-a06d-d7d2c4b4ca6c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c" status: 200 len: 1367 microversion: 2.1 time: 0.154636 Aug 24 03:39:05.054792 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 435/858] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:04 2022] GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:06.074930 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-04ffcded-51e7-40fb-9ebd-1c14c46185a7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:06.075555 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-04ffcded-51e7-40fb-9ebd-1c14c46185a7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: f97627fb-1853-4f70-a2be-00724183986c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:06.082051 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-04ffcded-51e7-40fb-9ebd-1c14c46185a7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:06.082571 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-04ffcded-51e7-40fb-9ebd-1c14c46185a7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:06.083012 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-04ffcded-51e7-40fb-9ebd-1c14c46185a7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:06.083707 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-04ffcded-51e7-40fb-9ebd-1c14c46185a7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:06.084165 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-04ffcded-51e7-40fb-9ebd-1c14c46185a7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:06.084595 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-04ffcded-51e7-40fb-9ebd-1c14c46185a7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:06.211613 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-04ffcded-51e7-40fb-9ebd-1c14c46185a7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:06.221061 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-04ffcded-51e7-40fb-9ebd-1c14c46185a7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c" status: 200 len: 1367 microversion: 2.1 time: 0.150037 Aug 24 03:39:06.221624 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 424/859] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:06 2022] GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:07.243460 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-bcd65611-a0b5-4b42-8095-912aff464293 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:07.251698 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-bcd65611-a0b5-4b42-8095-912aff464293 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: f97627fb-1853-4f70-a2be-00724183986c] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:07.252491 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bcd65611-a0b5-4b42-8095-912aff464293 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:07.253101 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bcd65611-a0b5-4b42-8095-912aff464293 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:07.253909 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bcd65611-a0b5-4b42-8095-912aff464293 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:07.254404 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bcd65611-a0b5-4b42-8095-912aff464293 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:07.254921 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bcd65611-a0b5-4b42-8095-912aff464293 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:07.255417 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bcd65611-a0b5-4b42-8095-912aff464293 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:07.406679 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-bcd65611-a0b5-4b42-8095-912aff464293 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:07.416530 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-bcd65611-a0b5-4b42-8095-912aff464293 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c" status: 200 len: 1367 microversion: 2.1 time: 0.178439 Aug 24 03:39:07.430668 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 436/860] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:07 2022] GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:07.787803 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-35bd62e0-ae42-4e23-80cb-b0f7cb4f54d3 req-2f7d2412-4537-4d8b-ae26-f7897898d5ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f97627fb-1853-4f70-a2be-00724183986c", "tag": "5deb7f82-699e-4990-a7ae-5514176e9872"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:07.801058 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-35bd62e0-ae42-4e23-80cb-b0f7cb4f54d3 req-2f7d2412-4537-4d8b-ae26-f7897898d5ad service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:07.801544 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-35bd62e0-ae42-4e23-80cb-b0f7cb4f54d3 req-2f7d2412-4537-4d8b-ae26-f7897898d5ad service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:07.801978 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-35bd62e0-ae42-4e23-80cb-b0f7cb4f54d3 req-2f7d2412-4537-4d8b-ae26-f7897898d5ad service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:07.813909 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-35bd62e0-ae42-4e23-80cb-b0f7cb4f54d3 req-2f7d2412-4537-4d8b-ae26-f7897898d5ad service nova] Creating event network-changed:5deb7f82-699e-4990-a7ae-5514176e9872 for instance f97627fb-1853-4f70-a2be-00724183986c on hv-cinder-85426 Aug 24 03:39:07.819335 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-35bd62e0-ae42-4e23-80cb-b0f7cb4f54d3 req-2f7d2412-4537-4d8b-ae26-f7897898d5ad service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035696 Aug 24 03:39:07.820467 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 425/861] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:08.438933 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-fec12e43-ce7f-4e09-a366-16851df9fcdc tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:08.439549 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-fec12e43-ce7f-4e09-a366-16851df9fcdc tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: f97627fb-1853-4f70-a2be-00724183986c] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:08.445970 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fec12e43-ce7f-4e09-a366-16851df9fcdc tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:08.446481 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fec12e43-ce7f-4e09-a366-16851df9fcdc tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:08.446990 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fec12e43-ce7f-4e09-a366-16851df9fcdc tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:08.447845 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fec12e43-ce7f-4e09-a366-16851df9fcdc tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:08.448362 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fec12e43-ce7f-4e09-a366-16851df9fcdc tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:08.448847 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fec12e43-ce7f-4e09-a366-16851df9fcdc tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:08.579880 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-fec12e43-ce7f-4e09-a366-16851df9fcdc tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:08.587526 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-fec12e43-ce7f-4e09-a366-16851df9fcdc tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c" status: 200 len: 1367 microversion: 2.1 time: 0.153223 Aug 24 03:39:08.588089 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 437/862] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:08 2022] GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:09.609097 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-65a6c1ae-2b19-457c-be84-67a984d19afd tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:09.609737 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-65a6c1ae-2b19-457c-be84-67a984d19afd tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: f97627fb-1853-4f70-a2be-00724183986c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:09.616294 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-65a6c1ae-2b19-457c-be84-67a984d19afd tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:09.616805 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-65a6c1ae-2b19-457c-be84-67a984d19afd tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:09.617257 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-65a6c1ae-2b19-457c-be84-67a984d19afd tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:09.617958 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-65a6c1ae-2b19-457c-be84-67a984d19afd tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:09.618418 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-65a6c1ae-2b19-457c-be84-67a984d19afd tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:09.618848 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-65a6c1ae-2b19-457c-be84-67a984d19afd tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:09.747304 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-65a6c1ae-2b19-457c-be84-67a984d19afd tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:09.755625 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-65a6c1ae-2b19-457c-be84-67a984d19afd tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c" status: 200 len: 1367 microversion: 2.1 time: 0.151101 Aug 24 03:39:09.756181 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 426/863] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:09 2022] GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:10.776494 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-9fcff71e-75e8-412c-a5c3-dc1cc51c22bd tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:10.777167 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-9fcff71e-75e8-412c-a5c3-dc1cc51c22bd tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: f97627fb-1853-4f70-a2be-00724183986c] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:10.784081 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9fcff71e-75e8-412c-a5c3-dc1cc51c22bd tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:10.784563 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9fcff71e-75e8-412c-a5c3-dc1cc51c22bd tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:10.785038 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9fcff71e-75e8-412c-a5c3-dc1cc51c22bd tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:10.785727 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9fcff71e-75e8-412c-a5c3-dc1cc51c22bd tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:10.786180 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9fcff71e-75e8-412c-a5c3-dc1cc51c22bd tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:10.786614 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9fcff71e-75e8-412c-a5c3-dc1cc51c22bd tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:10.918930 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-9fcff71e-75e8-412c-a5c3-dc1cc51c22bd tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:10.927508 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-9fcff71e-75e8-412c-a5c3-dc1cc51c22bd tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c" status: 200 len: 1367 microversion: 2.1 time: 0.154857 Aug 24 03:39:10.928074 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 438/864] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:10 2022] GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:11.949199 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-bdfa1786-015a-4a92-9e61-5d11b290a2b9 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:11.949754 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-bdfa1786-015a-4a92-9e61-5d11b290a2b9 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: f97627fb-1853-4f70-a2be-00724183986c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:11.956601 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bdfa1786-015a-4a92-9e61-5d11b290a2b9 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:11.957115 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bdfa1786-015a-4a92-9e61-5d11b290a2b9 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:11.957553 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bdfa1786-015a-4a92-9e61-5d11b290a2b9 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:11.958244 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bdfa1786-015a-4a92-9e61-5d11b290a2b9 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:11.958697 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bdfa1786-015a-4a92-9e61-5d11b290a2b9 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:11.959123 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bdfa1786-015a-4a92-9e61-5d11b290a2b9 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:12.090105 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-bdfa1786-015a-4a92-9e61-5d11b290a2b9 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:12.099034 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-bdfa1786-015a-4a92-9e61-5d11b290a2b9 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c" status: 200 len: 1367 microversion: 2.1 time: 0.153906 Aug 24 03:39:12.099599 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 427/865] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:11 2022] GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:13.119556 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-18194497-af43-46d1-9433-29a9b62fb6df tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:13.120171 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-18194497-af43-46d1-9433-29a9b62fb6df tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: f97627fb-1853-4f70-a2be-00724183986c] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:13.128033 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-18194497-af43-46d1-9433-29a9b62fb6df tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:13.128528 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-18194497-af43-46d1-9433-29a9b62fb6df tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:13.129004 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-18194497-af43-46d1-9433-29a9b62fb6df tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:13.129713 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-18194497-af43-46d1-9433-29a9b62fb6df tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:13.130168 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-18194497-af43-46d1-9433-29a9b62fb6df tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:13.130597 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-18194497-af43-46d1-9433-29a9b62fb6df tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:13.194925 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-31cc9178-01ff-4e3d-b435-7ec48ff4be7d req-411e3a35-ffd4-432e-ac70-94687024dbf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f97627fb-1853-4f70-a2be-00724183986c", "name": "network-vif-plugged", "status": "completed", "tag": "5deb7f82-699e-4990-a7ae-5514176e9872"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:13.201335 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=2 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:13.202482 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=12 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:13.207890 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-31cc9178-01ff-4e3d-b435-7ec48ff4be7d req-411e3a35-ffd4-432e-ac70-94687024dbf8 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:13.208385 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-31cc9178-01ff-4e3d-b435-7ec48ff4be7d req-411e3a35-ffd4-432e-ac70-94687024dbf8 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:13.208846 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-31cc9178-01ff-4e3d-b435-7ec48ff4be7d req-411e3a35-ffd4-432e-ac70-94687024dbf8 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:13.222018 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-31cc9178-01ff-4e3d-b435-7ec48ff4be7d req-411e3a35-ffd4-432e-ac70-94687024dbf8 service nova] Creating event network-vif-plugged:5deb7f82-699e-4990-a7ae-5514176e9872 for instance f97627fb-1853-4f70-a2be-00724183986c on hv-cinder-85426 Aug 24 03:39:13.227496 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-31cc9178-01ff-4e3d-b435-7ec48ff4be7d req-411e3a35-ffd4-432e-ac70-94687024dbf8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036023 Aug 24 03:39:13.228579 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 428/866] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:13.277201 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-18194497-af43-46d1-9433-29a9b62fb6df tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:13.287696 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-18194497-af43-46d1-9433-29a9b62fb6df tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c" status: 200 len: 1367 microversion: 2.1 time: 0.172017 Aug 24 03:39:13.288358 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 439/867] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:13 2022] GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:14.309231 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2497883d-99cd-437d-abd6-38d3f40ed18f tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:14.309937 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2497883d-99cd-437d-abd6-38d3f40ed18f tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: f97627fb-1853-4f70-a2be-00724183986c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:14.316599 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2497883d-99cd-437d-abd6-38d3f40ed18f tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:14.317116 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2497883d-99cd-437d-abd6-38d3f40ed18f tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:14.317558 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2497883d-99cd-437d-abd6-38d3f40ed18f tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:14.318253 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2497883d-99cd-437d-abd6-38d3f40ed18f tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:14.318708 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2497883d-99cd-437d-abd6-38d3f40ed18f tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:14.319140 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2497883d-99cd-437d-abd6-38d3f40ed18f tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:14.450202 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2497883d-99cd-437d-abd6-38d3f40ed18f tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:14.460057 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2497883d-99cd-437d-abd6-38d3f40ed18f tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c" status: 200 len: 1367 microversion: 2.1 time: 0.155550 Aug 24 03:39:14.460690 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 429/868] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:14 2022] GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:15.481559 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-7492d528-6c3e-4188-af0c-defb2cdbf0d7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:15.482171 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-7492d528-6c3e-4188-af0c-defb2cdbf0d7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: f97627fb-1853-4f70-a2be-00724183986c] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:15.489879 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7492d528-6c3e-4188-af0c-defb2cdbf0d7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:15.490364 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7492d528-6c3e-4188-af0c-defb2cdbf0d7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:15.490828 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7492d528-6c3e-4188-af0c-defb2cdbf0d7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:15.491521 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7492d528-6c3e-4188-af0c-defb2cdbf0d7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:15.491974 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7492d528-6c3e-4188-af0c-defb2cdbf0d7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:15.492400 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7492d528-6c3e-4188-af0c-defb2cdbf0d7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:15.624110 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-7492d528-6c3e-4188-af0c-defb2cdbf0d7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:15.631835 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-7492d528-6c3e-4188-af0c-defb2cdbf0d7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c" status: 200 len: 1558 microversion: 2.1 time: 0.154194 Aug 24 03:39:15.632393 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 440/869] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:15 2022] GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:15.651722 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-83db60f6-46b6-441a-902d-83e718f03091 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:15.652234 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-83db60f6-46b6-441a-902d-83e718f03091 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: f97627fb-1853-4f70-a2be-00724183986c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:15.659551 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-83db60f6-46b6-441a-902d-83e718f03091 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:15.660055 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-83db60f6-46b6-441a-902d-83e718f03091 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:15.660497 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-83db60f6-46b6-441a-902d-83e718f03091 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:15.661231 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-83db60f6-46b6-441a-902d-83e718f03091 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:15.661690 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-83db60f6-46b6-441a-902d-83e718f03091 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:15.662120 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-83db60f6-46b6-441a-902d-83e718f03091 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:15.743193 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-83db60f6-46b6-441a-902d-83e718f03091 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095319 Aug 24 03:39:15.744069 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 430/870] 10.222.0.81 () {58 vars in 1275 bytes} [Wed Aug 24 03:39:15 2022] GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:16.679287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-974fefde-63aa-4dfa-916c-36a07471ef43 req-c4b4838c-a80b-4b6d-9ff5-81a18f4898a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f97627fb-1853-4f70-a2be-00724183986c", "tag": "5deb7f82-699e-4990-a7ae-5514176e9872"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:16.690283 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-974fefde-63aa-4dfa-916c-36a07471ef43 req-c4b4838c-a80b-4b6d-9ff5-81a18f4898a7 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:16.690767 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-974fefde-63aa-4dfa-916c-36a07471ef43 req-c4b4838c-a80b-4b6d-9ff5-81a18f4898a7 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:16.692126 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-974fefde-63aa-4dfa-916c-36a07471ef43 req-c4b4838c-a80b-4b6d-9ff5-81a18f4898a7 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:16.702914 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-974fefde-63aa-4dfa-916c-36a07471ef43 req-c4b4838c-a80b-4b6d-9ff5-81a18f4898a7 service nova] Creating event network-changed:5deb7f82-699e-4990-a7ae-5514176e9872 for instance f97627fb-1853-4f70-a2be-00724183986c on hv-cinder-85426 Aug 24 03:39:16.708240 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-974fefde-63aa-4dfa-916c-36a07471ef43 req-c4b4838c-a80b-4b6d-9ff5-81a18f4898a7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032696 Aug 24 03:39:16.709043 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 441/871] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:52.578641 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:52.579438 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=64 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:52.584055 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-9bc0ef1b-46c2-4fae-971d-f12401c7af11 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:52.584570 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-9bc0ef1b-46c2-4fae-971d-f12401c7af11 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: f97627fb-1853-4f70-a2be-00724183986c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:52.592375 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9bc0ef1b-46c2-4fae-971d-f12401c7af11 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:52.592917 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9bc0ef1b-46c2-4fae-971d-f12401c7af11 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:52.593359 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9bc0ef1b-46c2-4fae-971d-f12401c7af11 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:52.594048 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9bc0ef1b-46c2-4fae-971d-f12401c7af11 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:52.594760 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9bc0ef1b-46c2-4fae-971d-f12401c7af11 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:52.595214 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-9bc0ef1b-46c2-4fae-971d-f12401c7af11 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:52.619158 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-9bc0ef1b-46c2-4fae-971d-f12401c7af11 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c/ips" status: 200 len: 151 microversion: 2.1 time: 0.042124 Aug 24 03:39:52.619741 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 431/872] 10.222.0.81 () {58 vars in 1248 bytes} [Wed Aug 24 03:39:52 2022] GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:52.632648 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-11941f9a-e8a8-414c-a839-4aec46677b48 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d5db7a4-7446-4dc4-a573-c369df523b6d"}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:52.635449 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-11941f9a-e8a8-414c-a839-4aec46677b48 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: f97627fb-1853-4f70-a2be-00724183986c] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:52.637793 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:52.638462 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell1:SELECT=32 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:52.645378 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-11941f9a-e8a8-414c-a839-4aec46677b48 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:52.645872 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-11941f9a-e8a8-414c-a839-4aec46677b48 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:52.646317 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-11941f9a-e8a8-414c-a839-4aec46677b48 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:52.647018 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-11941f9a-e8a8-414c-a839-4aec46677b48 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:52.647479 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-11941f9a-e8a8-414c-a839-4aec46677b48 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:52.647911 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-11941f9a-e8a8-414c-a839-4aec46677b48 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:52.728936 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.wsgi [None req-11941f9a-e8a8-414c-a839-4aec46677b48 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] HTTP exception thrown: Invalid volume: volume 8d5db7a4-7446-4dc4-a573-c369df523b6d is already attached to instances: 3a493863-6fda-4311-8271-48f093698726 Aug 24 03:39:52.730669 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-11941f9a-e8a8-414c-a839-4aec46677b48 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Request method failure captured: Aug 24 03:39:52.730669 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: request: POST /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c/os-volume_attachments HTTP/1.1 Aug 24 03:39:52.730669 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept: application/json Aug 24 03:39:52.730669 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept-Encoding: identity Aug 24 03:39:52.730669 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Connection: close Aug 24 03:39:52.730669 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Length: 74 Aug 24 03:39:52.730669 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Type: application/json Aug 24 03:39:52.730669 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Host: 10.222.0.81 Aug 24 03:39:52.730669 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Openstack-System-Scope: None Aug 24 03:39:52.730669 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: User-Agent: python-urllib3/1.26.11 Aug 24 03:39:52.730669 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Auth-Token: gAAAAABjBZ0XgUUzqu8gYfTR5JQX5djiu9sm-YoBY9uX3hewM3ja7I-QxGErX1ku_wIHDECZdrppQollXQEV9Swedz4AIA8EAZxPt4bZAsmGPPzDLcGWKEKc4DE209NR03zPKRHuS4Do7t619MPq8qEyrIO2sytfgfnhiclpGeyn5wm_QNbkDu4 Aug 24 03:39:52.730669 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Id: None Aug 24 03:39:52.730669 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Name: None Aug 24 03:39:52.730669 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Identity-Status: Confirmed Aug 24 03:39:52.730669 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Is-Admin-Project: True Aug 24 03:39:52.730669 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Id: default Aug 24 03:39:52.730669 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Name: Default Aug 24 03:39:52.730669 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Id: 4b05b1de2f064ba29a6d0f7f4c8b2a01 Aug 24 03:39:52.730669 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Name: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:39:52.730669 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Role: reader,member Aug 24 03:39:52.730669 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Roles: reader,member Aug 24 03:39:52.732302 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_4b05b1de2f064ba29a6d0f7f4c8b2a01", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}] Aug 24 03:39:52.732302 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:39:52.732302 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Id: 4b05b1de2f064ba29a6d0f7f4c8b2a01 Aug 24 03:39:52.732302 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:39:52.732302 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User: tempest-AttachVolumeNegativeTest-1777736198-project Aug 24 03:39:52.732302 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Id: default Aug 24 03:39:52.732302 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Name: Default Aug 24 03:39:52.732302 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Id: e9fa457d74c644a3ad740da44576a12f Aug 24 03:39:52.732302 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Name: tempest-AttachVolumeNegativeTest-1777736198-project Aug 24 03:39:52.732302 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Aug 24 03:39:52.732302 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: {"volumeAttachment": {"volumeId": "8d5db7a4-7446-4dc4-a573-c369df523b6d"}} Aug 24 03:39:52.732302 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: method: > Aug 24 03:39:52.733287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: exception: Invalid volume: volume 8d5db7a4-7446-4dc4-a573-c369df523b6d is already attached to instances: 3a493863-6fda-4311-8271-48f093698726 Aug 24 03:39:52.733287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: action_args: {'server_id': 'f97627fb-1853-4f70-a2be-00724183986c', 'body': {'volumeAttachment': {'volumeId': '8d5db7a4-7446-4dc4-a573-c369df523b6d'}}} Aug 24 03:39:52.733287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:39:52.733287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:52.733287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 03:39:52.733287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 03:39:52.733287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 03:39:52.733287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:39:52.733287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 03:39:52.733287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 03:39:52.733287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 03:39:52.733287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 03:39:52.733287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 03:39:52.733287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 03:39:52.733287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8d5db7a4-7446-4dc4-a573-c369df523b6d is already attached to instances: 3a493863-6fda-4311-8271-48f093698726 Aug 24 03:39:52.733287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:39:52.733287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:52.733287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:39:52.733287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:52.734755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:52.734755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:52.734755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:39:52.734755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:39:52.734755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:39:52.734755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:39:52.734755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:39:52.734755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:39:52.734755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:39:52.734755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:39:52.734755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:39:52.734755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:39:52.734755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 03:39:52.734755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 03:39:52.734755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8d5db7a4-7446-4dc4-a573-c369df523b6d is already attached to instances: 3a493863-6fda-4311-8271-48f093698726 Aug 24 03:39:52.734755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:39:52.734755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:52.734755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:39:52.734755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:52.734755 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:52.737537 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:52.737537 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:39:52.737537 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:39:52.737537 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8d5db7a4-7446-4dc4-a573-c369df523b6d is already attached to instances: 3a493863-6fda-4311-8271-48f093698726 Aug 24 03:39:52.737537 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:39:52.737537 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-11941f9a-e8a8-414c-a839-4aec46677b48 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Returning 400 to user: Invalid volume: volume 8d5db7a4-7446-4dc4-a573-c369df523b6d is already attached to instances: 3a493863-6fda-4311-8271-48f093698726 {{(pid=120709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:39:52.737537 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-11941f9a-e8a8-414c-a839-4aec46677b48 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "POST /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104315 Aug 24 03:39:52.737537 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 442/873] 10.222.0.81 () {60 vars in 1323 bytes} [Wed Aug 24 03:39:52 2022] POST /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:39:52.741637 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-36440760-6ea7-4d3b-85d8-7065317347a0 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:52.742143 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-36440760-6ea7-4d3b-85d8-7065317347a0 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: f97627fb-1853-4f70-a2be-00724183986c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:52.747916 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-36440760-6ea7-4d3b-85d8-7065317347a0 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:52.748401 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-36440760-6ea7-4d3b-85d8-7065317347a0 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:52.748858 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-36440760-6ea7-4d3b-85d8-7065317347a0 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:52.749544 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-36440760-6ea7-4d3b-85d8-7065317347a0 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:52.749994 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-36440760-6ea7-4d3b-85d8-7065317347a0 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:52.750412 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-36440760-6ea7-4d3b-85d8-7065317347a0 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:52.775817 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-36440760-6ea7-4d3b-85d8-7065317347a0 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: f97627fb-1853-4f70-a2be-00724183986c] Going to try to terminate instance {{(pid=120708) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:39:52.852690 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-36440760-6ea7-4d3b-85d8-7065317347a0 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "DELETE /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c" status: 204 len: 0 microversion: 2.1 time: 0.114489 Aug 24 03:39:52.853282 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 432/874] 10.222.0.81 () {58 vars in 1239 bytes} [Wed Aug 24 03:39:52 2022] DELETE /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:39:52.863395 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-26a44d6a-8c51-4c34-8a4c-d10f3ba7a6e5 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:52.864005 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-26a44d6a-8c51-4c34-8a4c-d10f3ba7a6e5 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: f97627fb-1853-4f70-a2be-00724183986c] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:52.870575 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-26a44d6a-8c51-4c34-8a4c-d10f3ba7a6e5 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:52.871082 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-26a44d6a-8c51-4c34-8a4c-d10f3ba7a6e5 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:52.871518 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-26a44d6a-8c51-4c34-8a4c-d10f3ba7a6e5 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:52.872201 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-26a44d6a-8c51-4c34-8a4c-d10f3ba7a6e5 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:52.872649 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-26a44d6a-8c51-4c34-8a4c-d10f3ba7a6e5 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:52.873101 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-26a44d6a-8c51-4c34-8a4c-d10f3ba7a6e5 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:52.999906 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-26a44d6a-8c51-4c34-8a4c-d10f3ba7a6e5 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:53.008663 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-26a44d6a-8c51-4c34-8a4c-d10f3ba7a6e5 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c" status: 200 len: 1683 microversion: 2.1 time: 0.149979 Aug 24 03:39:53.009253 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 443/875] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:52 2022] GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:54.031755 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-15babd0b-1131-4c25-a63c-5293af141874 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:54.032466 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-15babd0b-1131-4c25-a63c-5293af141874 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: f97627fb-1853-4f70-a2be-00724183986c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:54.038730 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-15babd0b-1131-4c25-a63c-5293af141874 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:54.039213 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-15babd0b-1131-4c25-a63c-5293af141874 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:54.039646 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-15babd0b-1131-4c25-a63c-5293af141874 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:54.040325 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-15babd0b-1131-4c25-a63c-5293af141874 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:54.040803 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-15babd0b-1131-4c25-a63c-5293af141874 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:54.041225 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-15babd0b-1131-4c25-a63c-5293af141874 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:54.175318 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-15babd0b-1131-4c25-a63c-5293af141874 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:54.182994 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-15babd0b-1131-4c25-a63c-5293af141874 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c" status: 200 len: 1683 microversion: 2.1 time: 0.155507 Aug 24 03:39:54.183546 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 433/876] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:54 2022] GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:55.205636 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-e24ccce3-37d8-48a5-879e-43beb973902d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:55.206944 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-e24ccce3-37d8-48a5-879e-43beb973902d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: f97627fb-1853-4f70-a2be-00724183986c] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:55.214134 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e24ccce3-37d8-48a5-879e-43beb973902d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:55.214855 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e24ccce3-37d8-48a5-879e-43beb973902d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:55.215233 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e24ccce3-37d8-48a5-879e-43beb973902d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:55.216013 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e24ccce3-37d8-48a5-879e-43beb973902d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:55.216403 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e24ccce3-37d8-48a5-879e-43beb973902d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:55.216871 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e24ccce3-37d8-48a5-879e-43beb973902d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:55.238540 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-b817499b-2e33-4016-abbc-c9398c3247e8 req-54d08a87-b1f9-4f99-8c3d-77625a1795a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f97627fb-1853-4f70-a2be-00724183986c", "name": "network-vif-deleted", "tag": "5deb7f82-699e-4990-a7ae-5514176e9872"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:55.250891 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-b817499b-2e33-4016-abbc-c9398c3247e8 req-54d08a87-b1f9-4f99-8c3d-77625a1795a6 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:55.251812 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-b817499b-2e33-4016-abbc-c9398c3247e8 req-54d08a87-b1f9-4f99-8c3d-77625a1795a6 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:55.252826 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-b817499b-2e33-4016-abbc-c9398c3247e8 req-54d08a87-b1f9-4f99-8c3d-77625a1795a6 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:55.267520 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-b817499b-2e33-4016-abbc-c9398c3247e8 req-54d08a87-b1f9-4f99-8c3d-77625a1795a6 service nova] Creating event network-vif-deleted:5deb7f82-699e-4990-a7ae-5514176e9872 for instance f97627fb-1853-4f70-a2be-00724183986c on hv-cinder-85426 Aug 24 03:39:55.273395 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-b817499b-2e33-4016-abbc-c9398c3247e8 req-54d08a87-b1f9-4f99-8c3d-77625a1795a6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039190 Aug 24 03:39:55.274462 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 434/877] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:55.295022 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-e24ccce3-37d8-48a5-879e-43beb973902d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:55.305146 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-e24ccce3-37d8-48a5-879e-43beb973902d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c" status: 200 len: 1615 microversion: 2.1 time: 0.103124 Aug 24 03:39:55.316948 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 444/878] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:55 2022] GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c => generated 1615 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:56.327421 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-fd7abc2a-b633-4629-b795-371ed478c857 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:56.328119 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-fd7abc2a-b633-4629-b795-371ed478c857 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: f97627fb-1853-4f70-a2be-00724183986c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:56.335775 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fd7abc2a-b633-4629-b795-371ed478c857 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:56.336262 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fd7abc2a-b633-4629-b795-371ed478c857 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:56.336700 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fd7abc2a-b633-4629-b795-371ed478c857 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:56.337421 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fd7abc2a-b633-4629-b795-371ed478c857 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:56.337874 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fd7abc2a-b633-4629-b795-371ed478c857 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:56.338348 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-fd7abc2a-b633-4629-b795-371ed478c857 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:56.357397 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-fd7abc2a-b633-4629-b795-371ed478c857 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] HTTP exception thrown: Instance f97627fb-1853-4f70-a2be-00724183986c could not be found. Aug 24 03:39:56.359304 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-fd7abc2a-b633-4629-b795-371ed478c857 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Request method failure captured: Aug 24 03:39:56.359304 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c HTTP/1.1 Aug 24 03:39:56.359304 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 24 03:39:56.359304 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 24 03:39:56.359304 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Connection: close Aug 24 03:39:56.359304 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 24 03:39:56.359304 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 24 03:39:56.359304 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Host: 10.222.0.81 Aug 24 03:39:56.359304 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 24 03:39:56.359304 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.11 Aug 24 03:39:56.359304 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjBZ0XgUUzqu8gYfTR5JQX5djiu9sm-YoBY9uX3hewM3ja7I-QxGErX1ku_wIHDECZdrppQollXQEV9Swedz4AIA8EAZxPt4bZAsmGPPzDLcGWKEKc4DE209NR03zPKRHuS4Do7t619MPq8qEyrIO2sytfgfnhiclpGeyn5wm_QNbkDu4 Aug 24 03:39:56.359304 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 24 03:39:56.359304 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 24 03:39:56.359304 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 24 03:39:56.359304 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 24 03:39:56.359304 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 24 03:39:56.359304 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 24 03:39:56.359304 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Id: 4b05b1de2f064ba29a6d0f7f4c8b2a01 Aug 24 03:39:56.359304 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:39:56.359304 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 24 03:39:56.359304 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 24 03:39:56.360941 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_4b05b1de2f064ba29a6d0f7f4c8b2a01", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}] Aug 24 03:39:56.360941 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:39:56.360941 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 4b05b1de2f064ba29a6d0f7f4c8b2a01 Aug 24 03:39:56.360941 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:39:56.360941 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User: tempest-AttachVolumeNegativeTest-1777736198-project Aug 24 03:39:56.360941 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 24 03:39:56.360941 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 24 03:39:56.360941 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Id: e9fa457d74c644a3ad740da44576a12f Aug 24 03:39:56.360941 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-AttachVolumeNegativeTest-1777736198-project Aug 24 03:39:56.360941 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: method: > Aug 24 03:39:56.360941 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: exception: Instance f97627fb-1853-4f70-a2be-00724183986c could not be found. Aug 24 03:39:56.360941 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: action_args: {'id': 'f97627fb-1853-4f70-a2be-00724183986c'} Aug 24 03:39:56.362043 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:39:56.362043 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:56.362043 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:39:56.362043 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:39:56.362043 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:39:56.362043 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:39:56.362043 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:39:56.362043 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:39:56.362043 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:39:56.362043 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:39:56.362043 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f97627fb-1853-4f70-a2be-00724183986c could not be found. Aug 24 03:39:56.362043 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:39:56.362043 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:56.362043 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:39:56.362043 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:56.362043 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:56.362043 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:56.362043 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:39:56.362043 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:39:56.362043 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:39:56.363601 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:39:56.363601 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:39:56.363601 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:39:56.363601 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:39:56.363601 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:39:56.363601 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:39:56.363601 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:39:56.363601 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f97627fb-1853-4f70-a2be-00724183986c could not be found. Aug 24 03:39:56.363601 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:39:56.363601 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:56.363601 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:39:56.363601 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:56.363601 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:56.363601 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:56.363601 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:39:56.363601 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:39:56.363601 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f97627fb-1853-4f70-a2be-00724183986c could not be found. Aug 24 03:39:56.363601 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:39:56.364985 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-fd7abc2a-b633-4629-b795-371ed478c857 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Returning 404 to user: Instance f97627fb-1853-4f70-a2be-00724183986c could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:39:56.364985 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-fd7abc2a-b633-4629-b795-371ed478c857 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c" status: 404 len: 111 microversion: 2.1 time: 0.037668 Aug 24 03:39:56.364985 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 435/879] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:56 2022] GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:39:56.369883 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-4a14cb46-209f-4e60-a4bf-282838a57965 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '.version_select at 0x7f942f1e6940>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:56.390540 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-4a14cb46-209f-4e60-a4bf-282838a57965 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-913596365" status: 202 len: 0 microversion: 2.1 time: 0.024375 Aug 24 03:39:56.391116 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 445/880] 10.222.0.81 () {58 vars in 1218 bytes} [Wed Aug 24 03:39:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-913596365 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:39:57.036196 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-cab27ea4-b640-4f97-bc66-3c194b83c1d7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:57.036691 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-cab27ea4-b640-4f97-bc66-3c194b83c1d7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 3a493863-6fda-4311-8271-48f093698726] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:57.042602 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cab27ea4-b640-4f97-bc66-3c194b83c1d7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:57.043088 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cab27ea4-b640-4f97-bc66-3c194b83c1d7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:57.043564 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cab27ea4-b640-4f97-bc66-3c194b83c1d7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:57.044262 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cab27ea4-b640-4f97-bc66-3c194b83c1d7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:57.044712 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cab27ea4-b640-4f97-bc66-3c194b83c1d7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:57.045164 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-cab27ea4-b640-4f97-bc66-3c194b83c1d7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:57.126321 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.objects.instance [None req-cab27ea4-b640-4f97-bc66-3c194b83c1d7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lazy-loading 'services' on Instance uuid 3a493863-6fda-4311-8271-48f093698726 {{(pid=120708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:39:57.199756 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-cab27ea4-b640-4f97-bc66-3c194b83c1d7 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "DELETE /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726/os-volume_attachments/8d5db7a4-7446-4dc4-a573-c369df523b6d" status: 202 len: 0 microversion: 2.1 time: 0.168396 Aug 24 03:39:57.200614 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 436/881] 10.222.0.81 () {58 vars in 1416 bytes} [Wed Aug 24 03:39:57 2022] DELETE /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726/os-volume_attachments/8d5db7a4-7446-4dc4-a573-c369df523b6d => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:39:57.209792 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-10a09aa0-0c0e-478a-bd4c-7956372cb3ff tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:57.211906 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-10a09aa0-0c0e-478a-bd4c-7956372cb3ff tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 3a493863-6fda-4311-8271-48f093698726] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:57.218823 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-10a09aa0-0c0e-478a-bd4c-7956372cb3ff tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:57.219432 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-10a09aa0-0c0e-478a-bd4c-7956372cb3ff tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:57.220138 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-10a09aa0-0c0e-478a-bd4c-7956372cb3ff tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:57.220854 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-10a09aa0-0c0e-478a-bd4c-7956372cb3ff tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:57.221310 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-10a09aa0-0c0e-478a-bd4c-7956372cb3ff tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:57.221735 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-10a09aa0-0c0e-478a-bd4c-7956372cb3ff tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:57.250649 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-10a09aa0-0c0e-478a-bd4c-7956372cb3ff tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045727 Aug 24 03:39:57.251119 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 446/882] 10.222.0.81 () {58 vars in 1302 bytes} [Wed Aug 24 03:39:57 2022] GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:58.265262 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-8be71beb-7d92-42b2-b34e-3ba3060b76bb tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:58.269257 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-8be71beb-7d92-42b2-b34e-3ba3060b76bb tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 3a493863-6fda-4311-8271-48f093698726] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:58.275622 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8be71beb-7d92-42b2-b34e-3ba3060b76bb tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:58.276116 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8be71beb-7d92-42b2-b34e-3ba3060b76bb tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:58.276554 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8be71beb-7d92-42b2-b34e-3ba3060b76bb tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:58.277553 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8be71beb-7d92-42b2-b34e-3ba3060b76bb tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:58.278017 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8be71beb-7d92-42b2-b34e-3ba3060b76bb tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:58.278446 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8be71beb-7d92-42b2-b34e-3ba3060b76bb tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:58.322867 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-8be71beb-7d92-42b2-b34e-3ba3060b76bb tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063043 Aug 24 03:39:58.323350 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 437/883] 10.222.0.81 () {58 vars in 1302 bytes} [Wed Aug 24 03:39:58 2022] GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:39:58.384511 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-801532d5-b831-4a56-b762-41bf4a034f56 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:58.385065 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-801532d5-b831-4a56-b762-41bf4a034f56 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 3a493863-6fda-4311-8271-48f093698726] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:58.391390 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-801532d5-b831-4a56-b762-41bf4a034f56 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:58.391882 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-801532d5-b831-4a56-b762-41bf4a034f56 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:58.392846 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-801532d5-b831-4a56-b762-41bf4a034f56 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:58.393537 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-801532d5-b831-4a56-b762-41bf4a034f56 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:58.394001 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-801532d5-b831-4a56-b762-41bf4a034f56 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:58.394427 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-801532d5-b831-4a56-b762-41bf4a034f56 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:58.419826 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-801532d5-b831-4a56-b762-41bf4a034f56 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 3a493863-6fda-4311-8271-48f093698726] Going to try to terminate instance {{(pid=120709) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:39:58.498425 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-801532d5-b831-4a56-b762-41bf4a034f56 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "DELETE /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726" status: 204 len: 0 microversion: 2.1 time: 0.117222 Aug 24 03:39:58.498921 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 447/884] 10.222.0.81 () {58 vars in 1239 bytes} [Wed Aug 24 03:39:58 2022] DELETE /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:39:58.507269 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-8bb5b01c-d0b8-4699-a467-fe4714245df0 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:58.507882 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-8bb5b01c-d0b8-4699-a467-fe4714245df0 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 3a493863-6fda-4311-8271-48f093698726] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:58.513840 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8bb5b01c-d0b8-4699-a467-fe4714245df0 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:58.514327 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8bb5b01c-d0b8-4699-a467-fe4714245df0 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:58.514761 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8bb5b01c-d0b8-4699-a467-fe4714245df0 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:58.515486 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8bb5b01c-d0b8-4699-a467-fe4714245df0 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:58.515937 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8bb5b01c-d0b8-4699-a467-fe4714245df0 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:58.516360 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8bb5b01c-d0b8-4699-a467-fe4714245df0 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:58.646058 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-8bb5b01c-d0b8-4699-a467-fe4714245df0 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:58.653844 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-8bb5b01c-d0b8-4699-a467-fe4714245df0 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726" status: 200 len: 1681 microversion: 2.1 time: 0.150390 Aug 24 03:39:58.654406 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 438/885] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:58 2022] GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:59.677133 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-546e35f8-d58f-42cb-8375-aae7a77261de tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:59.677828 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-546e35f8-d58f-42cb-8375-aae7a77261de tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 3a493863-6fda-4311-8271-48f093698726] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:59.683808 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-546e35f8-d58f-42cb-8375-aae7a77261de tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:59.684291 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-546e35f8-d58f-42cb-8375-aae7a77261de tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:59.684723 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-546e35f8-d58f-42cb-8375-aae7a77261de tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:59.685427 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-546e35f8-d58f-42cb-8375-aae7a77261de tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:59.685874 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-546e35f8-d58f-42cb-8375-aae7a77261de tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:59.686295 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-546e35f8-d58f-42cb-8375-aae7a77261de tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:59.818557 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-546e35f8-d58f-42cb-8375-aae7a77261de tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:59.826180 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-546e35f8-d58f-42cb-8375-aae7a77261de tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726" status: 200 len: 1681 microversion: 2.1 time: 0.153981 Aug 24 03:39:59.826744 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 448/886] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:59 2022] GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:00.848618 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a5d4d9ab-cc2e-49c1-ae0e-5f9ad7b615d1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:00.849931 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a5d4d9ab-cc2e-49c1-ae0e-5f9ad7b615d1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 3a493863-6fda-4311-8271-48f093698726] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:00.857713 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a5d4d9ab-cc2e-49c1-ae0e-5f9ad7b615d1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:00.858245 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a5d4d9ab-cc2e-49c1-ae0e-5f9ad7b615d1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:00.859032 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a5d4d9ab-cc2e-49c1-ae0e-5f9ad7b615d1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:00.860274 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a5d4d9ab-cc2e-49c1-ae0e-5f9ad7b615d1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:00.861176 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a5d4d9ab-cc2e-49c1-ae0e-5f9ad7b615d1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:00.861723 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a5d4d9ab-cc2e-49c1-ae0e-5f9ad7b615d1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:01.009691 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a5d4d9ab-cc2e-49c1-ae0e-5f9ad7b615d1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:01.019203 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a5d4d9ab-cc2e-49c1-ae0e-5f9ad7b615d1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726" status: 200 len: 1681 microversion: 2.1 time: 0.175251 Aug 24 03:40:01.019790 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 439/887] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:00 2022] GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:01.294354 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-0adc3aa6-6cf8-4e4a-824c-34c7dcb5539f req-5b1a5cc8-ab23-493a-8480-2d64f61549a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a493863-6fda-4311-8271-48f093698726", "name": "network-vif-deleted", "tag": "a3e235e1-9925-4bd2-ad87-9f5d93265022"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:01.305545 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-0adc3aa6-6cf8-4e4a-824c-34c7dcb5539f req-5b1a5cc8-ab23-493a-8480-2d64f61549a3 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:01.306141 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-0adc3aa6-6cf8-4e4a-824c-34c7dcb5539f req-5b1a5cc8-ab23-493a-8480-2d64f61549a3 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:01.306645 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-0adc3aa6-6cf8-4e4a-824c-34c7dcb5539f req-5b1a5cc8-ab23-493a-8480-2d64f61549a3 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:01.318956 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-0adc3aa6-6cf8-4e4a-824c-34c7dcb5539f req-5b1a5cc8-ab23-493a-8480-2d64f61549a3 service nova] Creating event network-vif-deleted:a3e235e1-9925-4bd2-ad87-9f5d93265022 for instance 3a493863-6fda-4311-8271-48f093698726 on hv-cinder-85426 Aug 24 03:40:01.323980 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-0adc3aa6-6cf8-4e4a-824c-34c7dcb5539f req-5b1a5cc8-ab23-493a-8480-2d64f61549a3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037849 Aug 24 03:40:01.325243 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 449/888] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:02.040135 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a509c5a0-31f2-44ca-a1f3-443186d9fd1b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:02.040754 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a509c5a0-31f2-44ca-a1f3-443186d9fd1b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 3a493863-6fda-4311-8271-48f093698726] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:02.047359 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a509c5a0-31f2-44ca-a1f3-443186d9fd1b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:02.047857 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a509c5a0-31f2-44ca-a1f3-443186d9fd1b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:02.048299 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a509c5a0-31f2-44ca-a1f3-443186d9fd1b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:02.049037 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a509c5a0-31f2-44ca-a1f3-443186d9fd1b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:02.049596 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a509c5a0-31f2-44ca-a1f3-443186d9fd1b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:02.050030 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a509c5a0-31f2-44ca-a1f3-443186d9fd1b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:02.063600 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-a509c5a0-31f2-44ca-a1f3-443186d9fd1b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] HTTP exception thrown: Instance 3a493863-6fda-4311-8271-48f093698726 could not be found. Aug 24 03:40:02.065808 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a509c5a0-31f2-44ca-a1f3-443186d9fd1b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Request method failure captured: Aug 24 03:40:02.065808 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726 HTTP/1.1 Aug 24 03:40:02.065808 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 24 03:40:02.065808 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 24 03:40:02.065808 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Connection: close Aug 24 03:40:02.065808 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 24 03:40:02.065808 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 24 03:40:02.065808 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Host: 10.222.0.81 Aug 24 03:40:02.065808 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 24 03:40:02.065808 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.11 Aug 24 03:40:02.065808 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjBZ0XgUUzqu8gYfTR5JQX5djiu9sm-YoBY9uX3hewM3ja7I-QxGErX1ku_wIHDECZdrppQollXQEV9Swedz4AIA8EAZxPt4bZAsmGPPzDLcGWKEKc4DE209NR03zPKRHuS4Do7t619MPq8qEyrIO2sytfgfnhiclpGeyn5wm_QNbkDu4 Aug 24 03:40:02.065808 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 24 03:40:02.065808 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 24 03:40:02.065808 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 24 03:40:02.065808 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 24 03:40:02.065808 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 24 03:40:02.065808 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 24 03:40:02.065808 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Id: 4b05b1de2f064ba29a6d0f7f4c8b2a01 Aug 24 03:40:02.065808 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:40:02.065808 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 24 03:40:02.065808 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 24 03:40:02.067364 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_4b05b1de2f064ba29a6d0f7f4c8b2a01", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}] Aug 24 03:40:02.067364 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:40:02.067364 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 4b05b1de2f064ba29a6d0f7f4c8b2a01 Aug 24 03:40:02.067364 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:40:02.067364 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User: tempest-AttachVolumeNegativeTest-1777736198-project Aug 24 03:40:02.067364 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 24 03:40:02.067364 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 24 03:40:02.067364 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Id: e9fa457d74c644a3ad740da44576a12f Aug 24 03:40:02.067364 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-AttachVolumeNegativeTest-1777736198-project Aug 24 03:40:02.067364 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: method: > Aug 24 03:40:02.067364 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: exception: Instance 3a493863-6fda-4311-8271-48f093698726 could not be found. Aug 24 03:40:02.067364 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: action_args: {'id': '3a493863-6fda-4311-8271-48f093698726'} Aug 24 03:40:02.068177 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:40:02.068177 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:02.068177 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:40:02.068177 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:40:02.068177 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:40:02.068177 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:40:02.068177 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:40:02.068177 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:40:02.068177 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:40:02.068177 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:40:02.068177 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a493863-6fda-4311-8271-48f093698726 could not be found. Aug 24 03:40:02.068177 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:40:02.068177 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:40:02.068177 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:40:02.068177 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:02.068177 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:40:02.068177 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:40:02.068177 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:40:02.068177 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:40:02.068177 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:40:02.069606 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:40:02.069606 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:40:02.069606 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:40:02.069606 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:40:02.069606 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:40:02.069606 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:40:02.069606 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:40:02.069606 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a493863-6fda-4311-8271-48f093698726 could not be found. Aug 24 03:40:02.069606 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:40:02.069606 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:40:02.069606 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:40:02.069606 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:02.069606 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:40:02.069606 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:40:02.069606 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:40:02.069606 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:40:02.069606 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a493863-6fda-4311-8271-48f093698726 could not be found. Aug 24 03:40:02.069606 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:40:02.071264 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a509c5a0-31f2-44ca-a1f3-443186d9fd1b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Returning 404 to user: Instance 3a493863-6fda-4311-8271-48f093698726 could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:40:02.071264 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a509c5a0-31f2-44ca-a1f3-443186d9fd1b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726" status: 404 len: 111 microversion: 2.1 time: 0.031052 Aug 24 03:40:02.071264 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 440/889] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:02 2022] GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:40:02.076511 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-93afe0e4-4836-46c2-a000-672fd45704aa tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '.version_select at 0x7f942f24ff70>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:02.096454 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-93afe0e4-4836-46c2-a000-672fd45704aa tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1952984710" status: 202 len: 0 microversion: 2.1 time: 0.023953 Aug 24 03:40:02.097081 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 450/890] 10.222.0.81 () {58 vars in 1221 bytes} [Wed Aug 24 03:40:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1952984710 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:40:02.744853 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a8c1e190-ebf7-4622-9eff-0b35767bc7fa tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Action: 'create', calling method: .version_select at 0x7f942f579a60>, body: {"keypair": {"name": "tempest-keypair-774911522", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7EEu6OSXom0CE3cJkGeX1pA9XVEfgQncHKtdAZ39TX16uaaAooaQrAOWzSX+6iL06D4Iirzuu725F7xwbO49lLZYgMe+TQZP7Q/QLQe9aIDOBeUH7svuZelYQuark7KQ=="}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:02.761195 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-a8c1e190-ebf7-4622-9eff-0b35767bc7fa tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Getting quotas for project 4b05b1de2f064ba29a6d0f7f4c8b2a01. Resources: {'key_pairs'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:40:02.764973 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-a8c1e190-ebf7-4622-9eff-0b35767bc7fa tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Getting quotas for user e9fa457d74c644a3ad740da44576a12f and project 4b05b1de2f064ba29a6d0f7f4c8b2a01. Resources: {'key_pairs'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:40:02.786866 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a8c1e190-ebf7-4622-9eff-0b35767bc7fa tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045923 Aug 24 03:40:02.787444 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 441/891] 10.222.0.81 () {60 vars in 1159 bytes} [Wed Aug 24 03:40:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:04.286799 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-df41526d-d4de-46cd-a23a-a49b67dacdd1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-122475145", "imageRef": "b7a40f0c-20c2-44cd-8b0e-f6e73a007d3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f7160365-682d-4059-86b5-916b47b99501"}], "security_groups": [{"name": "tempest-securitygroup--647102160"}], "key_name": "tempest-keypair-774911522", "user_data": "}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:04.389793 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.network.neutron [None req-df41526d-d4de-46cd-a23a-a49b67dacdd1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] validate_networks() for [('f7160365-682d-4059-86b5-916b47b99501', None, None, None, None, None)] {{(pid=120709) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:40:04.758430 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-df41526d-d4de-46cd-a23a-a49b67dacdd1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Flavor limits 0:0:0 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:40:04.758864 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-df41526d-d4de-46cd-a23a-a49b67dacdd1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Image limits 0:0:0 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:40:04.759343 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-df41526d-d4de-46cd-a23a-a49b67dacdd1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Flavor pref 0:0:0 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:40:04.759759 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-df41526d-d4de-46cd-a23a-a49b67dacdd1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Image pref 0:0:0 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:40:04.760176 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-df41526d-d4de-46cd-a23a-a49b67dacdd1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:40:04.769032 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-df41526d-d4de-46cd-a23a-a49b67dacdd1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:04.769537 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-df41526d-d4de-46cd-a23a-a49b67dacdd1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:04.770012 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-df41526d-d4de-46cd-a23a-a49b67dacdd1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:04.770740 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-df41526d-d4de-46cd-a23a-a49b67dacdd1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:04.771198 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-df41526d-d4de-46cd-a23a-a49b67dacdd1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:04.771647 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-df41526d-d4de-46cd-a23a-a49b67dacdd1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:04.789156 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.quota [None req-df41526d-d4de-46cd-a23a-a49b67dacdd1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Getting quotas for project 4b05b1de2f064ba29a6d0f7f4c8b2a01. Resources: {'ram', 'instances', 'cores'} {{(pid=120709) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:40:04.793108 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.quota [None req-df41526d-d4de-46cd-a23a-a49b67dacdd1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Getting quotas for user e9fa457d74c644a3ad740da44576a12f and project 4b05b1de2f064ba29a6d0f7f4c8b2a01. Resources: {'ram', 'instances', 'cores'} {{(pid=120709) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:40:04.804700 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-df41526d-d4de-46cd-a23a-a49b67dacdd1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Going to run 1 instances... {{(pid=120709) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:40:04.807120 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-df41526d-d4de-46cd-a23a-a49b67dacdd1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 58eaad0c-bee5-46ff-b47a-eb93875c7dff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b7a40f0c-20c2-44cd-8b0e-f6e73a007d3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120709) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:40:04.853627 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-df41526d-d4de-46cd-a23a-a49b67dacdd1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.571836 Aug 24 03:40:04.854273 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 451/892] 10.222.0.81 () {60 vars in 1147 bytes} [Wed Aug 24 03:40:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:40:04.866600 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-79156ec7-6a1c-4eb9-b0c0-60861ae15ee1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:04.867442 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-79156ec7-6a1c-4eb9-b0c0-60861ae15ee1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 58eaad0c-bee5-46ff-b47a-eb93875c7dff] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:04.922751 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-79156ec7-6a1c-4eb9-b0c0-60861ae15ee1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:04.930108 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-79156ec7-6a1c-4eb9-b0c0-60861ae15ee1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff" status: 200 len: 1240 microversion: 2.1 time: 0.068085 Aug 24 03:40:04.930671 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 442/893] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:04 2022] GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:05.951213 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-13cd952c-bb63-41c6-b202-d1db2f0c5edf tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:05.951925 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-13cd952c-bb63-41c6-b202-d1db2f0c5edf tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 58eaad0c-bee5-46ff-b47a-eb93875c7dff] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:05.959061 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-13cd952c-bb63-41c6-b202-d1db2f0c5edf tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:05.959558 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-13cd952c-bb63-41c6-b202-d1db2f0c5edf tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:05.960002 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-13cd952c-bb63-41c6-b202-d1db2f0c5edf tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:05.960705 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-13cd952c-bb63-41c6-b202-d1db2f0c5edf tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:05.961187 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-13cd952c-bb63-41c6-b202-d1db2f0c5edf tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:05.961616 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-13cd952c-bb63-41c6-b202-d1db2f0c5edf tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:06.032193 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-13cd952c-bb63-41c6-b202-d1db2f0c5edf tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:06.041550 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-13cd952c-bb63-41c6-b202-d1db2f0c5edf tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff" status: 200 len: 1298 microversion: 2.1 time: 0.094636 Aug 24 03:40:06.042148 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 452/894] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:05 2022] GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff => generated 1298 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:07.065495 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c9c9384e-c87c-4976-b3ef-d754942cbcc4 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:07.066112 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c9c9384e-c87c-4976-b3ef-d754942cbcc4 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 58eaad0c-bee5-46ff-b47a-eb93875c7dff] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:07.072508 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c9c9384e-c87c-4976-b3ef-d754942cbcc4 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:07.073029 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c9c9384e-c87c-4976-b3ef-d754942cbcc4 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:07.073469 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c9c9384e-c87c-4976-b3ef-d754942cbcc4 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:07.074165 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c9c9384e-c87c-4976-b3ef-d754942cbcc4 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:07.074623 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c9c9384e-c87c-4976-b3ef-d754942cbcc4 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:07.075053 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c9c9384e-c87c-4976-b3ef-d754942cbcc4 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:07.215502 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c9c9384e-c87c-4976-b3ef-d754942cbcc4 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:07.224540 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c9c9384e-c87c-4976-b3ef-d754942cbcc4 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff" status: 200 len: 1365 microversion: 2.1 time: 0.163024 Aug 24 03:40:07.225160 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 443/895] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:07 2022] GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:07.270747 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-068fcbc6-8f18-42de-a043-dad3cd8662d7 req-84397c8b-58f3-4082-b533-eeddf045f7b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58eaad0c-bee5-46ff-b47a-eb93875c7dff", "tag": "5df39e24-d429-4101-bebc-0fed1734db1b"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:07.287084 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-068fcbc6-8f18-42de-a043-dad3cd8662d7 req-84397c8b-58f3-4082-b533-eeddf045f7b0 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:07.287597 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-068fcbc6-8f18-42de-a043-dad3cd8662d7 req-84397c8b-58f3-4082-b533-eeddf045f7b0 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:07.288075 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-068fcbc6-8f18-42de-a043-dad3cd8662d7 req-84397c8b-58f3-4082-b533-eeddf045f7b0 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:07.300490 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-068fcbc6-8f18-42de-a043-dad3cd8662d7 req-84397c8b-58f3-4082-b533-eeddf045f7b0 service nova] Creating event network-changed:5df39e24-d429-4101-bebc-0fed1734db1b for instance 58eaad0c-bee5-46ff-b47a-eb93875c7dff on hv-cinder-85426 Aug 24 03:40:07.306584 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-068fcbc6-8f18-42de-a043-dad3cd8662d7 req-84397c8b-58f3-4082-b533-eeddf045f7b0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042012 Aug 24 03:40:07.307214 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 453/896] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:08.246118 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2dbcb64a-67a0-4cec-8520-2de54ede5531 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:08.246762 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2dbcb64a-67a0-4cec-8520-2de54ede5531 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 58eaad0c-bee5-46ff-b47a-eb93875c7dff] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:08.253401 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2dbcb64a-67a0-4cec-8520-2de54ede5531 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:08.253887 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2dbcb64a-67a0-4cec-8520-2de54ede5531 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:08.254323 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2dbcb64a-67a0-4cec-8520-2de54ede5531 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:08.255017 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2dbcb64a-67a0-4cec-8520-2de54ede5531 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:08.255475 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2dbcb64a-67a0-4cec-8520-2de54ede5531 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:08.255904 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2dbcb64a-67a0-4cec-8520-2de54ede5531 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:08.384468 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2dbcb64a-67a0-4cec-8520-2de54ede5531 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:08.397956 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2dbcb64a-67a0-4cec-8520-2de54ede5531 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff" status: 200 len: 1365 microversion: 2.1 time: 0.155650 Aug 24 03:40:08.398535 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 444/897] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:08 2022] GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:09.419277 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-100168a5-8afb-4432-82f9-f2b09b72b0ae tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:09.419983 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-100168a5-8afb-4432-82f9-f2b09b72b0ae tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 58eaad0c-bee5-46ff-b47a-eb93875c7dff] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:09.426828 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-100168a5-8afb-4432-82f9-f2b09b72b0ae tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:09.427365 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-100168a5-8afb-4432-82f9-f2b09b72b0ae tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:09.427794 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-100168a5-8afb-4432-82f9-f2b09b72b0ae tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:09.428491 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-100168a5-8afb-4432-82f9-f2b09b72b0ae tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:09.428983 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-100168a5-8afb-4432-82f9-f2b09b72b0ae tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:09.429434 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-100168a5-8afb-4432-82f9-f2b09b72b0ae tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:09.562749 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-100168a5-8afb-4432-82f9-f2b09b72b0ae tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:09.571292 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-100168a5-8afb-4432-82f9-f2b09b72b0ae tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff" status: 200 len: 1365 microversion: 2.1 time: 0.156283 Aug 24 03:40:09.571858 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 454/898] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:09 2022] GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:10.592422 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4f8958bb-91ad-4388-863b-5ab112c3e50e tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:10.593061 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-4f8958bb-91ad-4388-863b-5ab112c3e50e tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 58eaad0c-bee5-46ff-b47a-eb93875c7dff] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:10.600334 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4f8958bb-91ad-4388-863b-5ab112c3e50e tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:10.600851 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4f8958bb-91ad-4388-863b-5ab112c3e50e tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:10.601291 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4f8958bb-91ad-4388-863b-5ab112c3e50e tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:10.601981 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4f8958bb-91ad-4388-863b-5ab112c3e50e tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:10.602440 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4f8958bb-91ad-4388-863b-5ab112c3e50e tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:10.602866 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4f8958bb-91ad-4388-863b-5ab112c3e50e tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:10.728985 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4f8958bb-91ad-4388-863b-5ab112c3e50e tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:10.736928 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4f8958bb-91ad-4388-863b-5ab112c3e50e tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff" status: 200 len: 1365 microversion: 2.1 time: 0.148271 Aug 24 03:40:10.737498 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 445/899] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:10 2022] GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:11.761161 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-af1e4a84-7a4b-4144-9c8d-0378ea9fe8c9 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:11.761739 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-af1e4a84-7a4b-4144-9c8d-0378ea9fe8c9 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 58eaad0c-bee5-46ff-b47a-eb93875c7dff] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:11.770414 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-af1e4a84-7a4b-4144-9c8d-0378ea9fe8c9 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:11.770913 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-af1e4a84-7a4b-4144-9c8d-0378ea9fe8c9 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:11.772514 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-af1e4a84-7a4b-4144-9c8d-0378ea9fe8c9 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:11.772514 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-af1e4a84-7a4b-4144-9c8d-0378ea9fe8c9 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:11.772514 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-af1e4a84-7a4b-4144-9c8d-0378ea9fe8c9 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:11.772989 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-af1e4a84-7a4b-4144-9c8d-0378ea9fe8c9 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:12.119702 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-af1e4a84-7a4b-4144-9c8d-0378ea9fe8c9 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:12.127685 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-af1e4a84-7a4b-4144-9c8d-0378ea9fe8c9 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff" status: 200 len: 1365 microversion: 2.1 time: 0.370653 Aug 24 03:40:12.128286 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 455/900] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:11 2022] GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff => generated 1365 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:13.149276 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a4aaa85d-aa5a-4363-9dd5-7df505fa53ce tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:13.149911 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a4aaa85d-aa5a-4363-9dd5-7df505fa53ce tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 58eaad0c-bee5-46ff-b47a-eb93875c7dff] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:13.156522 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a4aaa85d-aa5a-4363-9dd5-7df505fa53ce tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:13.157030 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a4aaa85d-aa5a-4363-9dd5-7df505fa53ce tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:13.157461 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a4aaa85d-aa5a-4363-9dd5-7df505fa53ce tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:13.158723 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a4aaa85d-aa5a-4363-9dd5-7df505fa53ce tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:13.159175 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a4aaa85d-aa5a-4363-9dd5-7df505fa53ce tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:13.159597 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a4aaa85d-aa5a-4363-9dd5-7df505fa53ce tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:13.341478 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a4aaa85d-aa5a-4363-9dd5-7df505fa53ce tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:13.350649 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a4aaa85d-aa5a-4363-9dd5-7df505fa53ce tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff" status: 200 len: 1365 microversion: 2.1 time: 0.205118 Aug 24 03:40:13.351478 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 446/901] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:13 2022] GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:13.373940 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-92109f5e-8e90-49c7-af3a-b15d5c5795e7 req-244bb2f2-8539-49f9-be4a-9157566e9880 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58eaad0c-bee5-46ff-b47a-eb93875c7dff", "name": "network-vif-plugged", "status": "completed", "tag": "5df39e24-d429-4101-bebc-0fed1734db1b"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:13.384698 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-92109f5e-8e90-49c7-af3a-b15d5c5795e7 req-244bb2f2-8539-49f9-be4a-9157566e9880 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:13.385221 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-92109f5e-8e90-49c7-af3a-b15d5c5795e7 req-244bb2f2-8539-49f9-be4a-9157566e9880 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:13.385655 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-92109f5e-8e90-49c7-af3a-b15d5c5795e7 req-244bb2f2-8539-49f9-be4a-9157566e9880 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:13.397269 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-92109f5e-8e90-49c7-af3a-b15d5c5795e7 req-244bb2f2-8539-49f9-be4a-9157566e9880 service nova] Creating event network-vif-plugged:5df39e24-d429-4101-bebc-0fed1734db1b for instance 58eaad0c-bee5-46ff-b47a-eb93875c7dff on hv-cinder-85426 Aug 24 03:40:13.401931 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-92109f5e-8e90-49c7-af3a-b15d5c5795e7 req-244bb2f2-8539-49f9-be4a-9157566e9880 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031726 Aug 24 03:40:13.402736 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 456/902] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:14.371548 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-c75f8aa7-101a-4a66-bed1-2a99fb2f87d6 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:14.372176 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-c75f8aa7-101a-4a66-bed1-2a99fb2f87d6 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 58eaad0c-bee5-46ff-b47a-eb93875c7dff] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:14.378779 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c75f8aa7-101a-4a66-bed1-2a99fb2f87d6 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:14.379269 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c75f8aa7-101a-4a66-bed1-2a99fb2f87d6 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:14.379710 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c75f8aa7-101a-4a66-bed1-2a99fb2f87d6 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:14.380403 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c75f8aa7-101a-4a66-bed1-2a99fb2f87d6 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:14.380893 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c75f8aa7-101a-4a66-bed1-2a99fb2f87d6 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:14.381325 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-c75f8aa7-101a-4a66-bed1-2a99fb2f87d6 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:14.514343 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-c75f8aa7-101a-4a66-bed1-2a99fb2f87d6 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:14.523275 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-c75f8aa7-101a-4a66-bed1-2a99fb2f87d6 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff" status: 200 len: 1365 microversion: 2.1 time: 0.155697 Aug 24 03:40:14.523841 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 447/903] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:14 2022] GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:15.541305 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell0:SELECT=2 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:15.542086 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell0:SELECT=6 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:15.546038 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-2a76222b-1cc0-45d1-ba19-c059e2be589f tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:15.546726 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-2a76222b-1cc0-45d1-ba19-c059e2be589f tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 58eaad0c-bee5-46ff-b47a-eb93875c7dff] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:15.554166 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2a76222b-1cc0-45d1-ba19-c059e2be589f tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:15.554636 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2a76222b-1cc0-45d1-ba19-c059e2be589f tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:15.555065 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2a76222b-1cc0-45d1-ba19-c059e2be589f tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:15.555738 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2a76222b-1cc0-45d1-ba19-c059e2be589f tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:15.556180 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2a76222b-1cc0-45d1-ba19-c059e2be589f tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:15.556597 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2a76222b-1cc0-45d1-ba19-c059e2be589f tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:15.688814 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-2a76222b-1cc0-45d1-ba19-c059e2be589f tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:15.696664 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-2a76222b-1cc0-45d1-ba19-c059e2be589f tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff" status: 200 len: 1555 microversion: 2.1 time: 0.156870 Aug 24 03:40:15.697254 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 457/904] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:15 2022] GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:15.717061 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-af397936-ed26-4903-a4d4-689227af55ba tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:15.717575 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-af397936-ed26-4903-a4d4-689227af55ba tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 58eaad0c-bee5-46ff-b47a-eb93875c7dff] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:15.719473 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=6 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:15.726292 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-af397936-ed26-4903-a4d4-689227af55ba tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:15.726786 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-af397936-ed26-4903-a4d4-689227af55ba tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:15.727226 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-af397936-ed26-4903-a4d4-689227af55ba tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:15.727922 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-af397936-ed26-4903-a4d4-689227af55ba tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:15.728376 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-af397936-ed26-4903-a4d4-689227af55ba tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:15.728830 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-af397936-ed26-4903-a4d4-689227af55ba tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:15.803931 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-af397936-ed26-4903-a4d4-689227af55ba tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090681 Aug 24 03:40:15.804552 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 448/905] 10.222.0.81 () {58 vars in 1275 bytes} [Wed Aug 24 03:40:15 2022] GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:16.756832 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-a021948d-af91-45b3-ae39-9a97e778e543 req-dc20e54c-706a-44c4-8703-eeadf4e3d4d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58eaad0c-bee5-46ff-b47a-eb93875c7dff", "tag": "5df39e24-d429-4101-bebc-0fed1734db1b"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:16.766365 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-a021948d-af91-45b3-ae39-9a97e778e543 req-dc20e54c-706a-44c4-8703-eeadf4e3d4d2 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:16.766848 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-a021948d-af91-45b3-ae39-9a97e778e543 req-dc20e54c-706a-44c4-8703-eeadf4e3d4d2 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:16.767297 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-a021948d-af91-45b3-ae39-9a97e778e543 req-dc20e54c-706a-44c4-8703-eeadf4e3d4d2 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:16.780304 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-a021948d-af91-45b3-ae39-9a97e778e543 req-dc20e54c-706a-44c4-8703-eeadf4e3d4d2 service nova] Creating event network-changed:5df39e24-d429-4101-bebc-0fed1734db1b for instance 58eaad0c-bee5-46ff-b47a-eb93875c7dff on hv-cinder-85426 Aug 24 03:40:16.786338 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-a021948d-af91-45b3-ae39-9a97e778e543 req-dc20e54c-706a-44c4-8703-eeadf4e3d4d2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033228 Aug 24 03:40:16.787222 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 458/906] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:40:17.677646 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-e093f1cc-96cc-4328-9a92-60e541b1edcd tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:17.678854 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-e093f1cc-96cc-4328-9a92-60e541b1edcd tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:17.679119 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-c9f48968-4f6e-4aad-b253-716c49a29e26 req-ece674d3-94a6-417c-95fb-e2b4279b7762 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ee318a0-695b-431d-98cc-0d21560a2508", "tag": "b8c721ca-e1f1-4111-b00e-57a5d43c8885"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:17.694317 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e093f1cc-96cc-4328-9a92-60e541b1edcd tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:17.697128 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e093f1cc-96cc-4328-9a92-60e541b1edcd tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:17.698015 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e093f1cc-96cc-4328-9a92-60e541b1edcd tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:17.699935 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e093f1cc-96cc-4328-9a92-60e541b1edcd tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:17.702449 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-c9f48968-4f6e-4aad-b253-716c49a29e26 req-ece674d3-94a6-417c-95fb-e2b4279b7762 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:17.703132 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e093f1cc-96cc-4328-9a92-60e541b1edcd tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:17.703787 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e093f1cc-96cc-4328-9a92-60e541b1edcd tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:17.706251 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-c9f48968-4f6e-4aad-b253-716c49a29e26 req-ece674d3-94a6-417c-95fb-e2b4279b7762 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:17.707973 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-c9f48968-4f6e-4aad-b253-716c49a29e26 req-ece674d3-94a6-417c-95fb-e2b4279b7762 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:17.726312 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-c9f48968-4f6e-4aad-b253-716c49a29e26 req-ece674d3-94a6-417c-95fb-e2b4279b7762 service nova] Creating event network-changed:b8c721ca-e1f1-4111-b00e-57a5d43c8885 for instance 7ee318a0-695b-431d-98cc-0d21560a2508 on hv-cinder-85426 Aug 24 03:40:17.739788 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-e093f1cc-96cc-4328-9a92-60e541b1edcd tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Going to try to terminate instance {{(pid=120708) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:40:17.743686 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-c9f48968-4f6e-4aad-b253-716c49a29e26 req-ece674d3-94a6-417c-95fb-e2b4279b7762 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071539 Aug 24 03:40:17.745704 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:17.748068 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 459/907] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:40:17.840363 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-e093f1cc-96cc-4328-9a92-60e541b1edcd tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "DELETE /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 204 len: 0 microversion: 2.1 time: 0.173500 Aug 24 03:40:17.841678 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 449/908] 10.222.0.81 () {58 vars in 1239 bytes} [Wed Aug 24 03:40:17 2022] DELETE /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:40:17.852375 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-03065bc4-ea84-42d0-88f2-fa04e4dff2b0 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:17.853747 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-03065bc4-ea84-42d0-88f2-fa04e4dff2b0 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:17.864862 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-03065bc4-ea84-42d0-88f2-fa04e4dff2b0 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:17.865668 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-03065bc4-ea84-42d0-88f2-fa04e4dff2b0 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:17.866491 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-03065bc4-ea84-42d0-88f2-fa04e4dff2b0 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:17.867247 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-03065bc4-ea84-42d0-88f2-fa04e4dff2b0 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:17.867894 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-03065bc4-ea84-42d0-88f2-fa04e4dff2b0 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:17.868335 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-03065bc4-ea84-42d0-88f2-fa04e4dff2b0 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:18.034613 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-03065bc4-ea84-42d0-88f2-fa04e4dff2b0 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:18.044123 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-03065bc4-ea84-42d0-88f2-fa04e4dff2b0 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1568 microversion: 2.1 time: 0.197199 Aug 24 03:40:18.045123 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 460/909] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:17 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1568 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:19.066810 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-514ce867-af29-4d3a-9e27-476c0665056a tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:19.067510 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-514ce867-af29-4d3a-9e27-476c0665056a tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:19.073910 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-514ce867-af29-4d3a-9e27-476c0665056a tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:19.074397 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-514ce867-af29-4d3a-9e27-476c0665056a tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:19.074833 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-514ce867-af29-4d3a-9e27-476c0665056a tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:19.075523 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-514ce867-af29-4d3a-9e27-476c0665056a tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:19.075977 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-514ce867-af29-4d3a-9e27-476c0665056a tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:19.076404 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-514ce867-af29-4d3a-9e27-476c0665056a tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:19.211512 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-514ce867-af29-4d3a-9e27-476c0665056a tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:19.219328 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-514ce867-af29-4d3a-9e27-476c0665056a tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1568 microversion: 2.1 time: 0.157252 Aug 24 03:40:19.219902 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 450/910] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:19 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:20.066709 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-41e8f1b8-b83c-49ca-a88e-0f4f7c95ff81 req-5034f5b2-6154-4dbc-82cd-63b3d0dee169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee318a0-695b-431d-98cc-0d21560a2508", "name": "network-vif-deleted", "tag": "b8c721ca-e1f1-4111-b00e-57a5d43c8885"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:20.076527 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-41e8f1b8-b83c-49ca-a88e-0f4f7c95ff81 req-5034f5b2-6154-4dbc-82cd-63b3d0dee169 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:20.076979 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-41e8f1b8-b83c-49ca-a88e-0f4f7c95ff81 req-5034f5b2-6154-4dbc-82cd-63b3d0dee169 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:20.077410 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-41e8f1b8-b83c-49ca-a88e-0f4f7c95ff81 req-5034f5b2-6154-4dbc-82cd-63b3d0dee169 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:20.088861 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-41e8f1b8-b83c-49ca-a88e-0f4f7c95ff81 req-5034f5b2-6154-4dbc-82cd-63b3d0dee169 service nova] Creating event network-vif-deleted:b8c721ca-e1f1-4111-b00e-57a5d43c8885 for instance 7ee318a0-695b-431d-98cc-0d21560a2508 on hv-cinder-85426 Aug 24 03:40:20.093390 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-41e8f1b8-b83c-49ca-a88e-0f4f7c95ff81 req-5034f5b2-6154-4dbc-82cd-63b3d0dee169 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030662 Aug 24 03:40:20.094283 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 461/911] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:20.242286 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0ed1a329-37c2-4e81-ad5e-d11148c8f38a tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:20.242900 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0ed1a329-37c2-4e81-ad5e-d11148c8f38a tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:20.249334 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0ed1a329-37c2-4e81-ad5e-d11148c8f38a tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:20.249814 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0ed1a329-37c2-4e81-ad5e-d11148c8f38a tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:20.250246 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0ed1a329-37c2-4e81-ad5e-d11148c8f38a tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:20.250927 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0ed1a329-37c2-4e81-ad5e-d11148c8f38a tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:20.251404 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0ed1a329-37c2-4e81-ad5e-d11148c8f38a tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:20.251824 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0ed1a329-37c2-4e81-ad5e-d11148c8f38a tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:20.319414 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-0ed1a329-37c2-4e81-ad5e-d11148c8f38a tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5588121cc364d30a8f01d17c4cfc6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dea7fb32dea4f75917d82973bf7e7e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:20.327566 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0ed1a329-37c2-4e81-ad5e-d11148c8f38a tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 200 len: 1383 microversion: 2.1 time: 0.088959 Aug 24 03:40:20.328074 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 451/912] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:20 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 1383 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:21.411197 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-07bd616d-e791-4d12-9cd0-bee5eed2afa5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:21.411892 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-07bd616d-e791-4d12-9cd0-bee5eed2afa5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] [instance: 7ee318a0-695b-431d-98cc-0d21560a2508] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:21.418075 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-07bd616d-e791-4d12-9cd0-bee5eed2afa5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:21.418582 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-07bd616d-e791-4d12-9cd0-bee5eed2afa5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:21.419016 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-07bd616d-e791-4d12-9cd0-bee5eed2afa5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:21.419700 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-07bd616d-e791-4d12-9cd0-bee5eed2afa5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:21.420151 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-07bd616d-e791-4d12-9cd0-bee5eed2afa5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:21.420573 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-07bd616d-e791-4d12-9cd0-bee5eed2afa5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:21.435199 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.wsgi [None req-07bd616d-e791-4d12-9cd0-bee5eed2afa5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] HTTP exception thrown: Instance 7ee318a0-695b-431d-98cc-0d21560a2508 could not be found. Aug 24 03:40:21.436850 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-07bd616d-e791-4d12-9cd0-bee5eed2afa5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Request method failure captured: Aug 24 03:40:21.436850 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: request: GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 HTTP/1.1 Aug 24 03:40:21.436850 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept: application/json Aug 24 03:40:21.436850 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept-Encoding: identity Aug 24 03:40:21.436850 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Connection: close Aug 24 03:40:21.436850 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Length: 0 Aug 24 03:40:21.436850 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Type: application/json Aug 24 03:40:21.436850 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Host: 10.222.0.81 Aug 24 03:40:21.436850 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Openstack-System-Scope: None Aug 24 03:40:21.436850 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: User-Agent: python-urllib3/1.26.11 Aug 24 03:40:21.436850 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Auth-Token: gAAAAABjBZyEfHKRtigTBPpEdtcKmhtb5_3a9qmXksXRTbO9vU4rrLSJKXRme3pvYCgmn2CrIbjv4RK7iUSEvCe7--aKa14xEnrf17R1aAuYcR4mmgzcAM4tjouJTw5y1tIn5AjHM0rNLWOlkzSa3yMh5R1JHeXWhjo27lAKT82SZHqDX_wvrQw Aug 24 03:40:21.436850 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Id: None Aug 24 03:40:21.436850 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Name: None Aug 24 03:40:21.436850 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Identity-Status: Confirmed Aug 24 03:40:21.436850 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Is-Admin-Project: True Aug 24 03:40:21.436850 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Id: default Aug 24 03:40:21.436850 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Name: Default Aug 24 03:40:21.436850 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Id: 5dea7fb32dea4f75917d82973bf7e7e6 Aug 24 03:40:21.436850 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Name: tempest-TestShelveInstance-1475268519 Aug 24 03:40:21.436850 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Role: reader,member Aug 24 03:40:21.436850 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Roles: reader,member Aug 24 03:40:21.438505 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5dea7fb32dea4f75917d82973bf7e7e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5dea7fb32dea4f75917d82973bf7e7e6", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5dea7fb32dea4f75917d82973bf7e7e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5dea7fb32dea4f75917d82973bf7e7e6"}]}] Aug 24 03:40:21.438505 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant: tempest-TestShelveInstance-1475268519 Aug 24 03:40:21.438505 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Id: 5dea7fb32dea4f75917d82973bf7e7e6 Aug 24 03:40:21.438505 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Name: tempest-TestShelveInstance-1475268519 Aug 24 03:40:21.438505 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User: tempest-TestShelveInstance-1475268519-project Aug 24 03:40:21.438505 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Id: default Aug 24 03:40:21.438505 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Name: Default Aug 24 03:40:21.438505 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Id: e5588121cc364d30a8f01d17c4cfc6df Aug 24 03:40:21.438505 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Name: tempest-TestShelveInstance-1475268519-project Aug 24 03:40:21.438505 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: method: > Aug 24 03:40:21.438505 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: exception: Instance 7ee318a0-695b-431d-98cc-0d21560a2508 could not be found. Aug 24 03:40:21.438505 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: action_args: {'id': '7ee318a0-695b-431d-98cc-0d21560a2508'} Aug 24 03:40:21.440676 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:40:21.440676 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:21.440676 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:40:21.440676 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:40:21.440676 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:40:21.440676 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:40:21.440676 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:40:21.440676 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:40:21.440676 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:40:21.440676 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:40:21.440676 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ee318a0-695b-431d-98cc-0d21560a2508 could not be found. Aug 24 03:40:21.440676 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:40:21.440676 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:40:21.440676 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:40:21.440676 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:21.440676 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:40:21.440676 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:40:21.440676 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:40:21.440676 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:40:21.440676 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:40:21.442306 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:40:21.442306 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:40:21.442306 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:40:21.442306 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:40:21.442306 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:40:21.442306 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:40:21.442306 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:40:21.442306 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ee318a0-695b-431d-98cc-0d21560a2508 could not be found. Aug 24 03:40:21.442306 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:40:21.442306 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:40:21.442306 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:40:21.442306 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:21.442306 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:40:21.442306 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:40:21.442306 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:40:21.442306 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:40:21.442306 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ee318a0-695b-431d-98cc-0d21560a2508 could not be found. Aug 24 03:40:21.442306 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:40:21.443803 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-07bd616d-e791-4d12-9cd0-bee5eed2afa5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Returning 404 to user: Instance 7ee318a0-695b-431d-98cc-0d21560a2508 could not be found. {{(pid=120709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:40:21.443803 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-07bd616d-e791-4d12-9cd0-bee5eed2afa5 tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508" status: 404 len: 111 microversion: 2.1 time: 0.032033 Aug 24 03:40:21.443803 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 462/913] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:21 2022] GET /compute/v2.1/servers/7ee318a0-695b-431d-98cc-0d21560a2508 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:40:21.599793 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-34ba99d1-b9e2-489f-a3e5-a75777054f4c tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] Calling method '.version_select at 0x7f94348ba5e0>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:21.620911 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-34ba99d1-b9e2-489f-a3e5-a75777054f4c tempest-TestShelveInstance-1475268519 tempest-TestShelveInstance-1475268519-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1590201589" status: 202 len: 0 microversion: 2.1 time: 0.025258 Aug 24 03:40:21.621493 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 452/914] 10.222.0.81 () {58 vars in 1254 bytes} [Wed Aug 24 03:40:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1590201589 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:40:47.070351 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-2c158f48-89e4-449f-a4c7-6492baced035 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:47.070913 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-2c158f48-89e4-449f-a4c7-6492baced035 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 58eaad0c-bee5-46ff-b47a-eb93875c7dff] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:47.072998 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:47.073641 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:47.079362 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2c158f48-89e4-449f-a4c7-6492baced035 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:47.079846 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2c158f48-89e4-449f-a4c7-6492baced035 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:47.080711 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2c158f48-89e4-449f-a4c7-6492baced035 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:47.081442 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2c158f48-89e4-449f-a4c7-6492baced035 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:47.081898 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2c158f48-89e4-449f-a4c7-6492baced035 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:47.082325 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2c158f48-89e4-449f-a4c7-6492baced035 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:47.107437 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-2c158f48-89e4-449f-a4c7-6492baced035 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff/ips" status: 200 len: 149 microversion: 2.1 time: 0.042209 Aug 24 03:40:47.107996 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 463/915] 10.222.0.81 () {58 vars in 1248 bytes} [Wed Aug 24 03:40:47 2022] GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:48.431802 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:48.432668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:48.436947 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-81d39d2b-e008-4054-951b-7d4a9273b08c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc125929-8eaa-405f-8c2c-2174fc2739d4"}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:48.439223 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-81d39d2b-e008-4054-951b-7d4a9273b08c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 58eaad0c-bee5-46ff-b47a-eb93875c7dff] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:48.447786 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-81d39d2b-e008-4054-951b-7d4a9273b08c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:48.448371 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-81d39d2b-e008-4054-951b-7d4a9273b08c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:48.448836 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-81d39d2b-e008-4054-951b-7d4a9273b08c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:48.449538 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-81d39d2b-e008-4054-951b-7d4a9273b08c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:48.450008 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-81d39d2b-e008-4054-951b-7d4a9273b08c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:48.450444 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-81d39d2b-e008-4054-951b-7d4a9273b08c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:48.720759 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-81d39d2b-e008-4054-951b-7d4a9273b08c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "POST /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290042 Aug 24 03:40:48.721394 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 453/916] 10.222.0.81 () {60 vars in 1323 bytes} [Wed Aug 24 03:40:48 2022] POST /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:56.248444 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-8a61407e-292f-4a3c-b2fc-49c096de3207 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc125929-8eaa-405f-8c2c-2174fc2739d4"}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:56.250769 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-8a61407e-292f-4a3c-b2fc-49c096de3207 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 58eaad0c-bee5-46ff-b47a-eb93875c7dff] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:56.256976 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8a61407e-292f-4a3c-b2fc-49c096de3207 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:56.257460 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8a61407e-292f-4a3c-b2fc-49c096de3207 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:56.257894 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8a61407e-292f-4a3c-b2fc-49c096de3207 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:56.258576 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8a61407e-292f-4a3c-b2fc-49c096de3207 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:56.259021 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8a61407e-292f-4a3c-b2fc-49c096de3207 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:56.260190 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8a61407e-292f-4a3c-b2fc-49c096de3207 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:56.342815 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.wsgi [None req-8a61407e-292f-4a3c-b2fc-49c096de3207 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] HTTP exception thrown: Invalid volume: volume fc125929-8eaa-405f-8c2c-2174fc2739d4 is already attached to instances: 58eaad0c-bee5-46ff-b47a-eb93875c7dff Aug 24 03:40:56.344694 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-8a61407e-292f-4a3c-b2fc-49c096de3207 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Request method failure captured: Aug 24 03:40:56.344694 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: request: POST /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff/os-volume_attachments HTTP/1.1 Aug 24 03:40:56.344694 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept: application/json Aug 24 03:40:56.344694 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept-Encoding: identity Aug 24 03:40:56.344694 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Connection: close Aug 24 03:40:56.344694 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Length: 74 Aug 24 03:40:56.344694 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Type: application/json Aug 24 03:40:56.344694 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Host: 10.222.0.81 Aug 24 03:40:56.344694 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Openstack-System-Scope: None Aug 24 03:40:56.344694 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: User-Agent: python-urllib3/1.26.11 Aug 24 03:40:56.344694 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Auth-Token: gAAAAABjBZ0XgUUzqu8gYfTR5JQX5djiu9sm-YoBY9uX3hewM3ja7I-QxGErX1ku_wIHDECZdrppQollXQEV9Swedz4AIA8EAZxPt4bZAsmGPPzDLcGWKEKc4DE209NR03zPKRHuS4Do7t619MPq8qEyrIO2sytfgfnhiclpGeyn5wm_QNbkDu4 Aug 24 03:40:56.344694 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Id: None Aug 24 03:40:56.344694 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Name: None Aug 24 03:40:56.344694 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Identity-Status: Confirmed Aug 24 03:40:56.344694 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Is-Admin-Project: True Aug 24 03:40:56.344694 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Id: default Aug 24 03:40:56.344694 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Name: Default Aug 24 03:40:56.344694 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Id: 4b05b1de2f064ba29a6d0f7f4c8b2a01 Aug 24 03:40:56.344694 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Name: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:40:56.344694 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Role: reader,member Aug 24 03:40:56.344694 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Roles: reader,member Aug 24 03:40:56.346356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_4b05b1de2f064ba29a6d0f7f4c8b2a01", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}] Aug 24 03:40:56.346356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:40:56.346356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Id: 4b05b1de2f064ba29a6d0f7f4c8b2a01 Aug 24 03:40:56.346356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:40:56.346356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User: tempest-AttachVolumeNegativeTest-1777736198-project Aug 24 03:40:56.346356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Id: default Aug 24 03:40:56.346356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Name: Default Aug 24 03:40:56.346356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Id: e9fa457d74c644a3ad740da44576a12f Aug 24 03:40:56.346356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Name: tempest-AttachVolumeNegativeTest-1777736198-project Aug 24 03:40:56.346356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Aug 24 03:40:56.346356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: {"volumeAttachment": {"volumeId": "fc125929-8eaa-405f-8c2c-2174fc2739d4"}} Aug 24 03:40:56.346356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: method: > Aug 24 03:40:56.347429 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: exception: Invalid volume: volume fc125929-8eaa-405f-8c2c-2174fc2739d4 is already attached to instances: 58eaad0c-bee5-46ff-b47a-eb93875c7dff Aug 24 03:40:56.347429 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: action_args: {'server_id': '58eaad0c-bee5-46ff-b47a-eb93875c7dff', 'body': {'volumeAttachment': {'volumeId': 'fc125929-8eaa-405f-8c2c-2174fc2739d4'}}} Aug 24 03:40:56.347429 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:40:56.347429 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:56.347429 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 03:40:56.347429 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 03:40:56.347429 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 03:40:56.347429 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:40:56.347429 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 03:40:56.347429 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 03:40:56.347429 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 03:40:56.347429 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 03:40:56.347429 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 03:40:56.347429 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 03:40:56.347429 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume fc125929-8eaa-405f-8c2c-2174fc2739d4 is already attached to instances: 58eaad0c-bee5-46ff-b47a-eb93875c7dff Aug 24 03:40:56.347429 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:40:56.347429 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:40:56.347429 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:40:56.347429 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:56.348917 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:40:56.348917 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:40:56.348917 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:40:56.348917 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:40:56.348917 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:40:56.348917 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:40:56.348917 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:40:56.348917 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:40:56.348917 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:40:56.348917 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:40:56.348917 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:40:56.348917 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:40:56.348917 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 03:40:56.348917 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 03:40:56.348917 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume fc125929-8eaa-405f-8c2c-2174fc2739d4 is already attached to instances: 58eaad0c-bee5-46ff-b47a-eb93875c7dff Aug 24 03:40:56.348917 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:40:56.348917 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:40:56.348917 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:40:56.348917 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:40:56.348917 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:40:56.350658 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:40:56.350658 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:40:56.350658 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:40:56.350658 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume fc125929-8eaa-405f-8c2c-2174fc2739d4 is already attached to instances: 58eaad0c-bee5-46ff-b47a-eb93875c7dff Aug 24 03:40:56.350658 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:40:56.350658 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-8a61407e-292f-4a3c-b2fc-49c096de3207 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Returning 400 to user: Invalid volume: volume fc125929-8eaa-405f-8c2c-2174fc2739d4 is already attached to instances: 58eaad0c-bee5-46ff-b47a-eb93875c7dff {{(pid=120709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:40:56.350658 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-8a61407e-292f-4a3c-b2fc-49c096de3207 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "POST /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103148 Aug 24 03:40:56.350658 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 464/917] 10.222.0.81 () {60 vars in 1323 bytes} [Wed Aug 24 03:40:56 2022] POST /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:40:56.410278 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-41e76ed6-7fd1-4f1d-9348-668f4d2f94dc tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:56.410854 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-41e76ed6-7fd1-4f1d-9348-668f4d2f94dc tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 58eaad0c-bee5-46ff-b47a-eb93875c7dff] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:56.417749 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-41e76ed6-7fd1-4f1d-9348-668f4d2f94dc tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:56.418168 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-41e76ed6-7fd1-4f1d-9348-668f4d2f94dc tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:56.418601 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-41e76ed6-7fd1-4f1d-9348-668f4d2f94dc tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:56.419281 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-41e76ed6-7fd1-4f1d-9348-668f4d2f94dc tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:56.419726 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-41e76ed6-7fd1-4f1d-9348-668f4d2f94dc tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:56.420144 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-41e76ed6-7fd1-4f1d-9348-668f4d2f94dc tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:56.500641 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.objects.instance [None req-41e76ed6-7fd1-4f1d-9348-668f4d2f94dc tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lazy-loading 'services' on Instance uuid 58eaad0c-bee5-46ff-b47a-eb93875c7dff {{(pid=120708) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:40:56.571951 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-41e76ed6-7fd1-4f1d-9348-668f4d2f94dc tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "DELETE /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff/os-volume_attachments/fc125929-8eaa-405f-8c2c-2174fc2739d4" status: 202 len: 0 microversion: 2.1 time: 0.166103 Aug 24 03:40:56.572667 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 454/918] 10.222.0.81 () {58 vars in 1416 bytes} [Wed Aug 24 03:40:56 2022] DELETE /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff/os-volume_attachments/fc125929-8eaa-405f-8c2c-2174fc2739d4 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:40:56.581159 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-975dfd43-a652-47cc-8ac3-330353cc329c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:56.583345 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-975dfd43-a652-47cc-8ac3-330353cc329c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 58eaad0c-bee5-46ff-b47a-eb93875c7dff] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:56.590307 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-975dfd43-a652-47cc-8ac3-330353cc329c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:56.590799 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-975dfd43-a652-47cc-8ac3-330353cc329c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:56.591230 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-975dfd43-a652-47cc-8ac3-330353cc329c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:56.591947 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-975dfd43-a652-47cc-8ac3-330353cc329c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:56.592580 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-975dfd43-a652-47cc-8ac3-330353cc329c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:56.593034 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-975dfd43-a652-47cc-8ac3-330353cc329c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:56.625439 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-975dfd43-a652-47cc-8ac3-330353cc329c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048177 Aug 24 03:40:56.626012 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 465/919] 10.222.0.81 () {58 vars in 1302 bytes} [Wed Aug 24 03:40:56 2022] GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:57.639822 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-0c2eedc8-b6bf-4af1-a235-9bcac637cced tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:57.642094 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-0c2eedc8-b6bf-4af1-a235-9bcac637cced tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 58eaad0c-bee5-46ff-b47a-eb93875c7dff] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:57.648181 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0c2eedc8-b6bf-4af1-a235-9bcac637cced tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:57.648662 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0c2eedc8-b6bf-4af1-a235-9bcac637cced tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:57.649119 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0c2eedc8-b6bf-4af1-a235-9bcac637cced tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:57.649830 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0c2eedc8-b6bf-4af1-a235-9bcac637cced tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:57.650284 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0c2eedc8-b6bf-4af1-a235-9bcac637cced tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:57.650703 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-0c2eedc8-b6bf-4af1-a235-9bcac637cced tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:57.679166 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-0c2eedc8-b6bf-4af1-a235-9bcac637cced tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044922 Aug 24 03:40:57.679701 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 455/920] 10.222.0.81 () {58 vars in 1302 bytes} [Wed Aug 24 03:40:57 2022] GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:40:57.741635 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-b5ec5d2f-8cb2-4140-9fdd-b4e95355fc32 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:57.742133 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-b5ec5d2f-8cb2-4140-9fdd-b4e95355fc32 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 58eaad0c-bee5-46ff-b47a-eb93875c7dff] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:57.750375 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b5ec5d2f-8cb2-4140-9fdd-b4e95355fc32 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:57.750881 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b5ec5d2f-8cb2-4140-9fdd-b4e95355fc32 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:57.751318 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b5ec5d2f-8cb2-4140-9fdd-b4e95355fc32 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:57.752026 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b5ec5d2f-8cb2-4140-9fdd-b4e95355fc32 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:57.752567 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b5ec5d2f-8cb2-4140-9fdd-b4e95355fc32 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:57.753086 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b5ec5d2f-8cb2-4140-9fdd-b4e95355fc32 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:57.780289 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-b5ec5d2f-8cb2-4140-9fdd-b4e95355fc32 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 58eaad0c-bee5-46ff-b47a-eb93875c7dff] Going to try to terminate instance {{(pid=120709) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:40:57.860215 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-b5ec5d2f-8cb2-4140-9fdd-b4e95355fc32 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "DELETE /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff" status: 204 len: 0 microversion: 2.1 time: 0.121804 Aug 24 03:40:57.861448 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 466/921] 10.222.0.81 () {58 vars in 1239 bytes} [Wed Aug 24 03:40:57 2022] DELETE /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:40:57.870655 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f1833b46-9bc2-43c0-992e-328247855978 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:57.871270 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f1833b46-9bc2-43c0-992e-328247855978 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 58eaad0c-bee5-46ff-b47a-eb93875c7dff] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:57.877233 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f1833b46-9bc2-43c0-992e-328247855978 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:57.877719 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f1833b46-9bc2-43c0-992e-328247855978 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:57.878164 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f1833b46-9bc2-43c0-992e-328247855978 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:57.878858 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f1833b46-9bc2-43c0-992e-328247855978 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:57.879313 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f1833b46-9bc2-43c0-992e-328247855978 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:57.879756 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f1833b46-9bc2-43c0-992e-328247855978 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:58.013195 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f1833b46-9bc2-43c0-992e-328247855978 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:58.020816 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f1833b46-9bc2-43c0-992e-328247855978 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff" status: 200 len: 1679 microversion: 2.1 time: 0.154804 Aug 24 03:40:58.021448 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 456/922] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:57 2022] GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:59.044158 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-b1cdb5ed-d664-4f7e-a7e3-54f5f3042ace tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:59.044892 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-b1cdb5ed-d664-4f7e-a7e3-54f5f3042ace tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 58eaad0c-bee5-46ff-b47a-eb93875c7dff] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:59.053992 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b1cdb5ed-d664-4f7e-a7e3-54f5f3042ace tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:59.054816 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b1cdb5ed-d664-4f7e-a7e3-54f5f3042ace tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:59.055543 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b1cdb5ed-d664-4f7e-a7e3-54f5f3042ace tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:59.057238 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b1cdb5ed-d664-4f7e-a7e3-54f5f3042ace tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:59.058014 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b1cdb5ed-d664-4f7e-a7e3-54f5f3042ace tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:59.058517 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b1cdb5ed-d664-4f7e-a7e3-54f5f3042ace tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:59.205642 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-b1cdb5ed-d664-4f7e-a7e3-54f5f3042ace tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:59.215044 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-b1cdb5ed-d664-4f7e-a7e3-54f5f3042ace tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff" status: 200 len: 1679 microversion: 2.1 time: 0.175619 Aug 24 03:40:59.215996 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 467/923] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:59 2022] GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:00.238795 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2dcf84fd-a9a3-4b57-88fe-3f9fe8cf7b7e tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:00.239524 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2dcf84fd-a9a3-4b57-88fe-3f9fe8cf7b7e tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 58eaad0c-bee5-46ff-b47a-eb93875c7dff] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:00.246672 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2dcf84fd-a9a3-4b57-88fe-3f9fe8cf7b7e tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:00.247164 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2dcf84fd-a9a3-4b57-88fe-3f9fe8cf7b7e tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:00.247604 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2dcf84fd-a9a3-4b57-88fe-3f9fe8cf7b7e tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:00.248311 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2dcf84fd-a9a3-4b57-88fe-3f9fe8cf7b7e tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:00.248789 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2dcf84fd-a9a3-4b57-88fe-3f9fe8cf7b7e tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:00.249221 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2dcf84fd-a9a3-4b57-88fe-3f9fe8cf7b7e tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:00.315165 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2dcf84fd-a9a3-4b57-88fe-3f9fe8cf7b7e tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:00.324495 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2dcf84fd-a9a3-4b57-88fe-3f9fe8cf7b7e tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff" status: 200 len: 1612 microversion: 2.1 time: 0.089532 Aug 24 03:41:00.332405 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 457/924] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:00 2022] GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff => generated 1612 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:00.592757 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-fcd22568-7f55-462b-8176-6bf0098455ad req-552dfca0-4af3-4903-a7de-ccb95170ef99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58eaad0c-bee5-46ff-b47a-eb93875c7dff", "name": "network-vif-deleted", "tag": "5df39e24-d429-4101-bebc-0fed1734db1b"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:00.604107 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-fcd22568-7f55-462b-8176-6bf0098455ad req-552dfca0-4af3-4903-a7de-ccb95170ef99 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:00.604584 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-fcd22568-7f55-462b-8176-6bf0098455ad req-552dfca0-4af3-4903-a7de-ccb95170ef99 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:00.605040 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-fcd22568-7f55-462b-8176-6bf0098455ad req-552dfca0-4af3-4903-a7de-ccb95170ef99 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:00.615928 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-fcd22568-7f55-462b-8176-6bf0098455ad req-552dfca0-4af3-4903-a7de-ccb95170ef99 service nova] Creating event network-vif-deleted:5df39e24-d429-4101-bebc-0fed1734db1b for instance 58eaad0c-bee5-46ff-b47a-eb93875c7dff on hv-cinder-85426 Aug 24 03:41:00.621376 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-fcd22568-7f55-462b-8176-6bf0098455ad req-552dfca0-4af3-4903-a7de-ccb95170ef99 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.263653 Aug 24 03:41:00.621964 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 468/925] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:01.346949 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f8b1d539-250a-46b2-aed7-2b79a8e97e51 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:01.347494 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f8b1d539-250a-46b2-aed7-2b79a8e97e51 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 58eaad0c-bee5-46ff-b47a-eb93875c7dff] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:01.355047 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f8b1d539-250a-46b2-aed7-2b79a8e97e51 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:01.355923 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f8b1d539-250a-46b2-aed7-2b79a8e97e51 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:01.356465 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f8b1d539-250a-46b2-aed7-2b79a8e97e51 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:01.357204 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f8b1d539-250a-46b2-aed7-2b79a8e97e51 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:01.357667 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f8b1d539-250a-46b2-aed7-2b79a8e97e51 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:01.358130 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f8b1d539-250a-46b2-aed7-2b79a8e97e51 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:01.372997 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-f8b1d539-250a-46b2-aed7-2b79a8e97e51 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] HTTP exception thrown: Instance 58eaad0c-bee5-46ff-b47a-eb93875c7dff could not be found. Aug 24 03:41:01.374845 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f8b1d539-250a-46b2-aed7-2b79a8e97e51 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Request method failure captured: Aug 24 03:41:01.374845 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff HTTP/1.1 Aug 24 03:41:01.374845 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 24 03:41:01.374845 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 24 03:41:01.374845 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Connection: close Aug 24 03:41:01.374845 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 24 03:41:01.374845 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 24 03:41:01.374845 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Host: 10.222.0.81 Aug 24 03:41:01.374845 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 24 03:41:01.374845 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.11 Aug 24 03:41:01.374845 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjBZ0XgUUzqu8gYfTR5JQX5djiu9sm-YoBY9uX3hewM3ja7I-QxGErX1ku_wIHDECZdrppQollXQEV9Swedz4AIA8EAZxPt4bZAsmGPPzDLcGWKEKc4DE209NR03zPKRHuS4Do7t619MPq8qEyrIO2sytfgfnhiclpGeyn5wm_QNbkDu4 Aug 24 03:41:01.374845 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 24 03:41:01.374845 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 24 03:41:01.374845 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 24 03:41:01.374845 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 24 03:41:01.374845 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 24 03:41:01.374845 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 24 03:41:01.374845 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Id: 4b05b1de2f064ba29a6d0f7f4c8b2a01 Aug 24 03:41:01.374845 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:41:01.374845 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 24 03:41:01.374845 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 24 03:41:01.377010 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_4b05b1de2f064ba29a6d0f7f4c8b2a01", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}] Aug 24 03:41:01.377010 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:41:01.377010 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 4b05b1de2f064ba29a6d0f7f4c8b2a01 Aug 24 03:41:01.377010 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:41:01.377010 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User: tempest-AttachVolumeNegativeTest-1777736198-project Aug 24 03:41:01.377010 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 24 03:41:01.377010 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 24 03:41:01.377010 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Id: e9fa457d74c644a3ad740da44576a12f Aug 24 03:41:01.377010 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-AttachVolumeNegativeTest-1777736198-project Aug 24 03:41:01.377010 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: method: > Aug 24 03:41:01.377010 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: exception: Instance 58eaad0c-bee5-46ff-b47a-eb93875c7dff could not be found. Aug 24 03:41:01.377010 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: action_args: {'id': '58eaad0c-bee5-46ff-b47a-eb93875c7dff'} Aug 24 03:41:01.377995 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:41:01.377995 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:01.377995 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:41:01.377995 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:41:01.377995 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:41:01.377995 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:41:01.377995 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:41:01.377995 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:41:01.377995 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:41:01.377995 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:41:01.377995 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58eaad0c-bee5-46ff-b47a-eb93875c7dff could not be found. Aug 24 03:41:01.377995 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:41:01.377995 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:41:01.377995 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:41:01.377995 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:01.377995 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:41:01.377995 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:41:01.377995 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:41:01.377995 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:41:01.377995 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:41:01.381061 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:41:01.381061 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:41:01.381061 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:41:01.381061 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:41:01.381061 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:41:01.381061 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:41:01.381061 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:41:01.381061 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58eaad0c-bee5-46ff-b47a-eb93875c7dff could not be found. Aug 24 03:41:01.381061 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:41:01.381061 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:41:01.381061 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:41:01.381061 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:01.381061 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:41:01.381061 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:41:01.381061 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:41:01.381061 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:41:01.381061 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58eaad0c-bee5-46ff-b47a-eb93875c7dff could not be found. Aug 24 03:41:01.381061 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:41:01.382389 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f8b1d539-250a-46b2-aed7-2b79a8e97e51 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Returning 404 to user: Instance 58eaad0c-bee5-46ff-b47a-eb93875c7dff could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:41:01.382389 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f8b1d539-250a-46b2-aed7-2b79a8e97e51 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff" status: 404 len: 111 microversion: 2.1 time: 0.033741 Aug 24 03:41:01.382389 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 458/926] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:01 2022] GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:41:01.388852 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-fe8c1ce9-8b11-4d7d-a1e8-5ee9b962dd45 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '.version_select at 0x7f942f235af0>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:01.408338 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-fe8c1ce9-8b11-4d7d-a1e8-5ee9b962dd45 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-774911522" status: 202 len: 0 microversion: 2.1 time: 0.024318 Aug 24 03:41:01.408907 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 469/927] 10.222.0.81 () {58 vars in 1218 bytes} [Wed Aug 24 03:41:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-774911522 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:41:02.030504 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-87940ecf-cf6d-424c-8cb9-c9c04aab94b6 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Action: 'create', calling method: .version_select at 0x7f942f3e8430>, body: {"keypair": {"name": "tempest-keypair-899419585", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANMQVB9iuRgH+ChFaJooCQUu5HkLKZc+rynvoQ7B+P7EzEFeqrvRbpCKTBG8IBm+7vJDVVEXE9yR8ZW5YPdkzyNRenYkBvKRdEVNQxiS/ydOVqNQLLRLJ9LfU82ojYswA=="}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:02.045835 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-87940ecf-cf6d-424c-8cb9-c9c04aab94b6 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Getting quotas for project 4b05b1de2f064ba29a6d0f7f4c8b2a01. Resources: {'key_pairs'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:41:02.049633 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-87940ecf-cf6d-424c-8cb9-c9c04aab94b6 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Getting quotas for user e9fa457d74c644a3ad740da44576a12f and project 4b05b1de2f064ba29a6d0f7f4c8b2a01. Resources: {'key_pairs'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:41:02.071583 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-87940ecf-cf6d-424c-8cb9-c9c04aab94b6 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044941 Aug 24 03:41:02.072710 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 459/928] 10.222.0.81 () {60 vars in 1159 bytes} [Wed Aug 24 03:41:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:41:03.349659 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-f055fdf4-22ca-4545-b981-f6c86d29ab7b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1761205741", "imageRef": "b7a40f0c-20c2-44cd-8b0e-f6e73a007d3e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f7160365-682d-4059-86b5-916b47b99501"}], "security_groups": [{"name": "tempest-securitygroup--104011631"}], "key_name": "tempest-keypair-899419585", "user_data": "}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:03.455187 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.network.neutron [None req-f055fdf4-22ca-4545-b981-f6c86d29ab7b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] validate_networks() for [('f7160365-682d-4059-86b5-916b47b99501', None, None, None, None, None)] {{(pid=120709) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:41:03.841617 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-f055fdf4-22ca-4545-b981-f6c86d29ab7b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Flavor limits 0:0:0 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:41:03.842049 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-f055fdf4-22ca-4545-b981-f6c86d29ab7b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Image limits 0:0:0 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:41:03.842525 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-f055fdf4-22ca-4545-b981-f6c86d29ab7b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Flavor pref 0:0:0 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:41:03.842971 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-f055fdf4-22ca-4545-b981-f6c86d29ab7b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Image pref 0:0:0 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:41:03.843384 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-f055fdf4-22ca-4545-b981-f6c86d29ab7b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:41:03.852119 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f055fdf4-22ca-4545-b981-f6c86d29ab7b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:03.853152 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f055fdf4-22ca-4545-b981-f6c86d29ab7b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:03.853616 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f055fdf4-22ca-4545-b981-f6c86d29ab7b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:03.854339 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f055fdf4-22ca-4545-b981-f6c86d29ab7b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:03.854793 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f055fdf4-22ca-4545-b981-f6c86d29ab7b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:03.855227 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f055fdf4-22ca-4545-b981-f6c86d29ab7b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:03.871976 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.quota [None req-f055fdf4-22ca-4545-b981-f6c86d29ab7b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Getting quotas for project 4b05b1de2f064ba29a6d0f7f4c8b2a01. Resources: {'ram', 'instances', 'cores'} {{(pid=120709) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:41:03.875875 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.quota [None req-f055fdf4-22ca-4545-b981-f6c86d29ab7b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Getting quotas for user e9fa457d74c644a3ad740da44576a12f and project 4b05b1de2f064ba29a6d0f7f4c8b2a01. Resources: {'ram', 'instances', 'cores'} {{(pid=120709) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:41:03.886654 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-f055fdf4-22ca-4545-b981-f6c86d29ab7b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Going to run 1 instances... {{(pid=120709) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:41:03.889024 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-f055fdf4-22ca-4545-b981-f6c86d29ab7b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 1ee8133d-9ad2-4fa3-b02f-f1266acca98c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b7a40f0c-20c2-44cd-8b0e-f6e73a007d3e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120709) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:41:03.940482 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-f055fdf4-22ca-4545-b981-f6c86d29ab7b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.595634 Aug 24 03:41:03.941151 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 470/929] 10.222.0.81 () {60 vars in 1147 bytes} [Wed Aug 24 03:41:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:41:03.952827 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-5c7b02ac-4deb-4a59-89e2-2c03b46d6f96 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:03.953437 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-5c7b02ac-4deb-4a59-89e2-2c03b46d6f96 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 1ee8133d-9ad2-4fa3-b02f-f1266acca98c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:04.010891 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-5c7b02ac-4deb-4a59-89e2-2c03b46d6f96 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:04.017945 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-5c7b02ac-4deb-4a59-89e2-2c03b46d6f96 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c" status: 200 len: 1241 microversion: 2.1 time: 0.069516 Aug 24 03:41:04.018767 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 460/930] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:03 2022] GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:05.039375 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-ae53d63e-2c9f-4cf9-876c-97de9b0c4f07 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:05.040025 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-ae53d63e-2c9f-4cf9-876c-97de9b0c4f07 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 1ee8133d-9ad2-4fa3-b02f-f1266acca98c] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:05.046240 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ae53d63e-2c9f-4cf9-876c-97de9b0c4f07 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:05.046733 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ae53d63e-2c9f-4cf9-876c-97de9b0c4f07 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:05.047177 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ae53d63e-2c9f-4cf9-876c-97de9b0c4f07 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:05.047874 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ae53d63e-2c9f-4cf9-876c-97de9b0c4f07 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:05.049036 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ae53d63e-2c9f-4cf9-876c-97de9b0c4f07 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:05.049548 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ae53d63e-2c9f-4cf9-876c-97de9b0c4f07 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:05.120711 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-ae53d63e-2c9f-4cf9-876c-97de9b0c4f07 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:05.128504 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-ae53d63e-2c9f-4cf9-876c-97de9b0c4f07 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c" status: 200 len: 1301 microversion: 2.1 time: 0.093588 Aug 24 03:41:05.129121 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 471/931] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:05 2022] GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c => generated 1301 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:06.151136 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-99659a32-3190-4cac-922f-a9abea5ef528 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:06.151894 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-99659a32-3190-4cac-922f-a9abea5ef528 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 1ee8133d-9ad2-4fa3-b02f-f1266acca98c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:06.158644 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-99659a32-3190-4cac-922f-a9abea5ef528 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:06.159158 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-99659a32-3190-4cac-922f-a9abea5ef528 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:06.159590 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-99659a32-3190-4cac-922f-a9abea5ef528 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:06.160286 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-99659a32-3190-4cac-922f-a9abea5ef528 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:06.160737 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-99659a32-3190-4cac-922f-a9abea5ef528 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:06.161182 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-99659a32-3190-4cac-922f-a9abea5ef528 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:06.544844 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-99659a32-3190-4cac-922f-a9abea5ef528 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:06.552573 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-99659a32-3190-4cac-922f-a9abea5ef528 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c" status: 200 len: 1366 microversion: 2.1 time: 0.405920 Aug 24 03:41:06.557237 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 461/932] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:06 2022] GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c => generated 1366 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:06.585326 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-a5e7b75d-2200-478c-9ea0-105831af7818 req-8205bcae-3ac8-409e-acec-aabb6bb3258f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ee8133d-9ad2-4fa3-b02f-f1266acca98c", "tag": "f5d61b9b-9e49-4c0a-9229-74a543762264"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:06.598398 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-a5e7b75d-2200-478c-9ea0-105831af7818 req-8205bcae-3ac8-409e-acec-aabb6bb3258f service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:06.599016 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-a5e7b75d-2200-478c-9ea0-105831af7818 req-8205bcae-3ac8-409e-acec-aabb6bb3258f service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:06.599561 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-a5e7b75d-2200-478c-9ea0-105831af7818 req-8205bcae-3ac8-409e-acec-aabb6bb3258f service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:06.614623 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-a5e7b75d-2200-478c-9ea0-105831af7818 req-8205bcae-3ac8-409e-acec-aabb6bb3258f service nova] Creating event network-changed:f5d61b9b-9e49-4c0a-9229-74a543762264 for instance 1ee8133d-9ad2-4fa3-b02f-f1266acca98c on hv-cinder-85426 Aug 24 03:41:06.620381 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-a5e7b75d-2200-478c-9ea0-105831af7818 req-8205bcae-3ac8-409e-acec-aabb6bb3258f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039881 Aug 24 03:41:06.621107 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 472/933] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:07.573730 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-32311270-ce66-46f3-9b53-c8b38f264b0c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:07.574255 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-32311270-ce66-46f3-9b53-c8b38f264b0c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 1ee8133d-9ad2-4fa3-b02f-f1266acca98c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:07.580547 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-32311270-ce66-46f3-9b53-c8b38f264b0c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:07.581055 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-32311270-ce66-46f3-9b53-c8b38f264b0c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:07.581488 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-32311270-ce66-46f3-9b53-c8b38f264b0c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:07.582177 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-32311270-ce66-46f3-9b53-c8b38f264b0c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:07.582624 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-32311270-ce66-46f3-9b53-c8b38f264b0c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:07.583043 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-32311270-ce66-46f3-9b53-c8b38f264b0c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:07.710672 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-32311270-ce66-46f3-9b53-c8b38f264b0c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:07.719339 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-32311270-ce66-46f3-9b53-c8b38f264b0c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c" status: 200 len: 1366 microversion: 2.1 time: 0.149524 Aug 24 03:41:07.720050 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 462/934] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:07 2022] GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:08.739965 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-c703125c-ecba-4269-946b-e07afe47e176 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:08.740672 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-c703125c-ecba-4269-946b-e07afe47e176 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 1ee8133d-9ad2-4fa3-b02f-f1266acca98c] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:08.747852 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c703125c-ecba-4269-946b-e07afe47e176 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:08.748320 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c703125c-ecba-4269-946b-e07afe47e176 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:08.748779 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c703125c-ecba-4269-946b-e07afe47e176 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:08.749476 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c703125c-ecba-4269-946b-e07afe47e176 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:08.749931 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c703125c-ecba-4269-946b-e07afe47e176 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:08.750363 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c703125c-ecba-4269-946b-e07afe47e176 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:08.881569 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-c703125c-ecba-4269-946b-e07afe47e176 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:08.889903 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-c703125c-ecba-4269-946b-e07afe47e176 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c" status: 200 len: 1366 microversion: 2.1 time: 0.154173 Aug 24 03:41:08.890473 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 473/935] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:08 2022] GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:09.910412 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-06746791-6484-4278-81a7-85de2e1653a3 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:09.911455 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-06746791-6484-4278-81a7-85de2e1653a3 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 1ee8133d-9ad2-4fa3-b02f-f1266acca98c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:09.918532 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06746791-6484-4278-81a7-85de2e1653a3 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:09.919044 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06746791-6484-4278-81a7-85de2e1653a3 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:09.919482 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06746791-6484-4278-81a7-85de2e1653a3 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:09.920177 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06746791-6484-4278-81a7-85de2e1653a3 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:09.920634 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06746791-6484-4278-81a7-85de2e1653a3 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:09.921093 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-06746791-6484-4278-81a7-85de2e1653a3 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:10.053987 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-06746791-6484-4278-81a7-85de2e1653a3 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:10.062325 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-06746791-6484-4278-81a7-85de2e1653a3 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c" status: 200 len: 1366 microversion: 2.1 time: 0.155829 Aug 24 03:41:10.062903 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 463/936] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:09 2022] GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:11.082940 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-2d980a78-2cea-44e5-b28e-2a7b602f293c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:11.083602 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-2d980a78-2cea-44e5-b28e-2a7b602f293c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 1ee8133d-9ad2-4fa3-b02f-f1266acca98c] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:11.090283 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2d980a78-2cea-44e5-b28e-2a7b602f293c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:11.090761 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2d980a78-2cea-44e5-b28e-2a7b602f293c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:11.091194 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2d980a78-2cea-44e5-b28e-2a7b602f293c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:11.091876 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2d980a78-2cea-44e5-b28e-2a7b602f293c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:11.092322 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2d980a78-2cea-44e5-b28e-2a7b602f293c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:11.092741 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2d980a78-2cea-44e5-b28e-2a7b602f293c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:11.223434 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-2d980a78-2cea-44e5-b28e-2a7b602f293c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:11.231803 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-2d980a78-2cea-44e5-b28e-2a7b602f293c tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c" status: 200 len: 1366 microversion: 2.1 time: 0.152666 Aug 24 03:41:11.232362 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 474/937] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:11 2022] GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:11.703292 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-2e682a6e-cfbf-437a-9116-4e846b31c4db req-9408ddf1-3036-45d8-9344-9b692141d7ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ee8133d-9ad2-4fa3-b02f-f1266acca98c", "name": "network-vif-plugged", "status": "completed", "tag": "f5d61b9b-9e49-4c0a-9229-74a543762264"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:11.714309 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-2e682a6e-cfbf-437a-9116-4e846b31c4db req-9408ddf1-3036-45d8-9344-9b692141d7ac service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:11.714793 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-2e682a6e-cfbf-437a-9116-4e846b31c4db req-9408ddf1-3036-45d8-9344-9b692141d7ac service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:11.715237 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-2e682a6e-cfbf-437a-9116-4e846b31c4db req-9408ddf1-3036-45d8-9344-9b692141d7ac service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:11.726526 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-2e682a6e-cfbf-437a-9116-4e846b31c4db req-9408ddf1-3036-45d8-9344-9b692141d7ac service nova] Creating event network-vif-plugged:f5d61b9b-9e49-4c0a-9229-74a543762264 for instance 1ee8133d-9ad2-4fa3-b02f-f1266acca98c on hv-cinder-85426 Aug 24 03:41:11.732489 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-2e682a6e-cfbf-437a-9116-4e846b31c4db req-9408ddf1-3036-45d8-9344-9b692141d7ac service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033036 Aug 24 03:41:11.733122 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 464/938] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:12.253417 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-694133f9-2999-4ddc-8680-1c549dd03cda tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:12.253960 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-694133f9-2999-4ddc-8680-1c549dd03cda tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 1ee8133d-9ad2-4fa3-b02f-f1266acca98c] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:12.261654 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-694133f9-2999-4ddc-8680-1c549dd03cda tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:12.262139 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-694133f9-2999-4ddc-8680-1c549dd03cda tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:12.262582 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-694133f9-2999-4ddc-8680-1c549dd03cda tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:12.263270 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-694133f9-2999-4ddc-8680-1c549dd03cda tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:12.263723 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-694133f9-2999-4ddc-8680-1c549dd03cda tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:12.264145 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-694133f9-2999-4ddc-8680-1c549dd03cda tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:12.391745 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-694133f9-2999-4ddc-8680-1c549dd03cda tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:12.399693 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-694133f9-2999-4ddc-8680-1c549dd03cda tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c" status: 200 len: 1366 microversion: 2.1 time: 0.150040 Aug 24 03:41:12.400289 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 475/939] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:12 2022] GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:13.422179 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4cc41e9c-6e3b-4703-9d6e-f1f093620a43 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:13.422879 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-4cc41e9c-6e3b-4703-9d6e-f1f093620a43 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 1ee8133d-9ad2-4fa3-b02f-f1266acca98c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:13.429070 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4cc41e9c-6e3b-4703-9d6e-f1f093620a43 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:13.429550 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4cc41e9c-6e3b-4703-9d6e-f1f093620a43 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:13.429986 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4cc41e9c-6e3b-4703-9d6e-f1f093620a43 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:13.430681 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4cc41e9c-6e3b-4703-9d6e-f1f093620a43 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:13.431154 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4cc41e9c-6e3b-4703-9d6e-f1f093620a43 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:13.431554 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4cc41e9c-6e3b-4703-9d6e-f1f093620a43 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:13.566836 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4cc41e9c-6e3b-4703-9d6e-f1f093620a43 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:13.575419 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4cc41e9c-6e3b-4703-9d6e-f1f093620a43 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c" status: 200 len: 1556 microversion: 2.1 time: 0.158432 Aug 24 03:41:13.575974 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 465/940] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:13 2022] GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:13.597231 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-359d909e-c0df-45fd-b48f-f337b7367d16 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:13.597767 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-359d909e-c0df-45fd-b48f-f337b7367d16 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 1ee8133d-9ad2-4fa3-b02f-f1266acca98c] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:13.604073 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-359d909e-c0df-45fd-b48f-f337b7367d16 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:13.604549 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-359d909e-c0df-45fd-b48f-f337b7367d16 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:13.605011 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-359d909e-c0df-45fd-b48f-f337b7367d16 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:13.605697 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-359d909e-c0df-45fd-b48f-f337b7367d16 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:13.606146 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-359d909e-c0df-45fd-b48f-f337b7367d16 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:13.606565 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-359d909e-c0df-45fd-b48f-f337b7367d16 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:13.684606 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-359d909e-c0df-45fd-b48f-f337b7367d16 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091443 Aug 24 03:41:13.685261 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 476/941] 10.222.0.81 () {58 vars in 1275 bytes} [Wed Aug 24 03:41:13 2022] GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:14.607677 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-5ab4f374-c3f8-4310-9cc3-c7bb8acf69be req-79245543-e3b1-46c1-a407-8fc7818ceb28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ee8133d-9ad2-4fa3-b02f-f1266acca98c", "tag": "f5d61b9b-9e49-4c0a-9229-74a543762264"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:14.612594 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=6 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:14.620072 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-5ab4f374-c3f8-4310-9cc3-c7bb8acf69be req-79245543-e3b1-46c1-a407-8fc7818ceb28 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:14.620677 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-5ab4f374-c3f8-4310-9cc3-c7bb8acf69be req-79245543-e3b1-46c1-a407-8fc7818ceb28 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:14.621201 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-5ab4f374-c3f8-4310-9cc3-c7bb8acf69be req-79245543-e3b1-46c1-a407-8fc7818ceb28 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:14.632538 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-5ab4f374-c3f8-4310-9cc3-c7bb8acf69be req-79245543-e3b1-46c1-a407-8fc7818ceb28 service nova] Creating event network-changed:f5d61b9b-9e49-4c0a-9229-74a543762264 for instance 1ee8133d-9ad2-4fa3-b02f-f1266acca98c on hv-cinder-85426 Aug 24 03:41:14.638624 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-5ab4f374-c3f8-4310-9cc3-c7bb8acf69be req-79245543-e3b1-46c1-a407-8fc7818ceb28 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034614 Aug 24 03:41:14.639297 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 466/942] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:44.949522 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell0:SELECT=2 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:44.950298 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell0:SELECT=6 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:44.951539 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:44.952158 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:44.956339 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-0811f5b6-dbb5-44b8-ad2e-587a745dfd0d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:44.956860 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-0811f5b6-dbb5-44b8-ad2e-587a745dfd0d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 1ee8133d-9ad2-4fa3-b02f-f1266acca98c] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:44.965458 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0811f5b6-dbb5-44b8-ad2e-587a745dfd0d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:44.965942 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0811f5b6-dbb5-44b8-ad2e-587a745dfd0d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:44.966628 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0811f5b6-dbb5-44b8-ad2e-587a745dfd0d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:44.967315 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0811f5b6-dbb5-44b8-ad2e-587a745dfd0d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:44.967768 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0811f5b6-dbb5-44b8-ad2e-587a745dfd0d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:44.968191 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0811f5b6-dbb5-44b8-ad2e-587a745dfd0d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:44.994881 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-0811f5b6-dbb5-44b8-ad2e-587a745dfd0d tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c/ips" status: 200 len: 149 microversion: 2.1 time: 0.046165 Aug 24 03:41:44.995444 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 477/943] 10.222.0.81 () {58 vars in 1248 bytes} [Wed Aug 24 03:41:44 2022] GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c/ips => generated 149 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:46.319936 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:46.320731 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:46.325168 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b57a6883-7410-4ad4-afb5-2662cf59eebe tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0dc04253-1993-4916-9ed8-b87babe4b094"}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:46.327575 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-b57a6883-7410-4ad4-afb5-2662cf59eebe tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 1ee8133d-9ad2-4fa3-b02f-f1266acca98c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:46.335582 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b57a6883-7410-4ad4-afb5-2662cf59eebe tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:46.336059 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b57a6883-7410-4ad4-afb5-2662cf59eebe tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:46.336492 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b57a6883-7410-4ad4-afb5-2662cf59eebe tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:46.337229 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b57a6883-7410-4ad4-afb5-2662cf59eebe tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:46.337658 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b57a6883-7410-4ad4-afb5-2662cf59eebe tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:46.338078 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b57a6883-7410-4ad4-afb5-2662cf59eebe tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:46.606376 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-b57a6883-7410-4ad4-afb5-2662cf59eebe tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "POST /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288159 Aug 24 03:41:46.606996 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 467/944] 10.222.0.81 () {60 vars in 1323 bytes} [Wed Aug 24 03:41:46 2022] POST /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:54.241714 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-69d5be8d-c8d2-45b0-93de-87c1ec864181 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:54.242260 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-69d5be8d-c8d2-45b0-93de-87c1ec864181 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 1ee8133d-9ad2-4fa3-b02f-f1266acca98c] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:54.248681 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-69d5be8d-c8d2-45b0-93de-87c1ec864181 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:54.249197 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-69d5be8d-c8d2-45b0-93de-87c1ec864181 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:54.249635 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-69d5be8d-c8d2-45b0-93de-87c1ec864181 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:54.250324 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-69d5be8d-c8d2-45b0-93de-87c1ec864181 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:54.250778 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-69d5be8d-c8d2-45b0-93de-87c1ec864181 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:54.251213 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-69d5be8d-c8d2-45b0-93de-87c1ec864181 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:54.331833 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.objects.instance [None req-69d5be8d-c8d2-45b0-93de-87c1ec864181 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lazy-loading 'services' on Instance uuid 1ee8133d-9ad2-4fa3-b02f-f1266acca98c {{(pid=120709) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:41:54.405415 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-69d5be8d-c8d2-45b0-93de-87c1ec864181 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "DELETE /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c/os-volume_attachments/0dc04253-1993-4916-9ed8-b87babe4b094" status: 202 len: 0 microversion: 2.1 time: 0.167583 Aug 24 03:41:54.406085 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 478/945] 10.222.0.81 () {58 vars in 1416 bytes} [Wed Aug 24 03:41:54 2022] DELETE /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c/os-volume_attachments/0dc04253-1993-4916-9ed8-b87babe4b094 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:41:54.415857 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-bfa2753f-bea0-4700-b5ff-9c346d7696a1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:54.418192 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-bfa2753f-bea0-4700-b5ff-9c346d7696a1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 1ee8133d-9ad2-4fa3-b02f-f1266acca98c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:54.425469 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bfa2753f-bea0-4700-b5ff-9c346d7696a1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:54.425959 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bfa2753f-bea0-4700-b5ff-9c346d7696a1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:54.426394 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bfa2753f-bea0-4700-b5ff-9c346d7696a1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:54.427089 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bfa2753f-bea0-4700-b5ff-9c346d7696a1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:54.427545 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bfa2753f-bea0-4700-b5ff-9c346d7696a1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:54.428606 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-bfa2753f-bea0-4700-b5ff-9c346d7696a1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:54.458712 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-bfa2753f-bea0-4700-b5ff-9c346d7696a1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047944 Aug 24 03:41:54.459461 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 468/946] 10.222.0.81 () {58 vars in 1302 bytes} [Wed Aug 24 03:41:54 2022] GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:41:55.472974 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-84ac56d1-fcba-41e2-8fbf-8c89a52029fb tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:55.475373 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-84ac56d1-fcba-41e2-8fbf-8c89a52029fb tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 1ee8133d-9ad2-4fa3-b02f-f1266acca98c] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:55.481598 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-84ac56d1-fcba-41e2-8fbf-8c89a52029fb tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:55.482084 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-84ac56d1-fcba-41e2-8fbf-8c89a52029fb tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:55.482528 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-84ac56d1-fcba-41e2-8fbf-8c89a52029fb tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:55.483223 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-84ac56d1-fcba-41e2-8fbf-8c89a52029fb tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:55.483676 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-84ac56d1-fcba-41e2-8fbf-8c89a52029fb tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:55.484101 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-84ac56d1-fcba-41e2-8fbf-8c89a52029fb tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:55.512816 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-84ac56d1-fcba-41e2-8fbf-8c89a52029fb tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044782 Aug 24 03:41:55.513368 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 479/947] 10.222.0.81 () {58 vars in 1302 bytes} [Wed Aug 24 03:41:55 2022] GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:41:55.573515 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2d2af214-b814-4f0f-8e0d-9356cb10ac48 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:55.574029 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2d2af214-b814-4f0f-8e0d-9356cb10ac48 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 1ee8133d-9ad2-4fa3-b02f-f1266acca98c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:55.580332 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2d2af214-b814-4f0f-8e0d-9356cb10ac48 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:55.580849 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2d2af214-b814-4f0f-8e0d-9356cb10ac48 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:55.581288 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2d2af214-b814-4f0f-8e0d-9356cb10ac48 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:55.581976 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2d2af214-b814-4f0f-8e0d-9356cb10ac48 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:55.582490 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2d2af214-b814-4f0f-8e0d-9356cb10ac48 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:55.582918 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2d2af214-b814-4f0f-8e0d-9356cb10ac48 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:55.608457 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2d2af214-b814-4f0f-8e0d-9356cb10ac48 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 1ee8133d-9ad2-4fa3-b02f-f1266acca98c] Going to try to terminate instance {{(pid=120708) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:41:55.682224 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2d2af214-b814-4f0f-8e0d-9356cb10ac48 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "DELETE /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c" status: 204 len: 0 microversion: 2.1 time: 0.112273 Aug 24 03:41:55.683006 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 469/948] 10.222.0.81 () {58 vars in 1239 bytes} [Wed Aug 24 03:41:55 2022] DELETE /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:41:55.691151 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-480c7d33-9ee4-4469-8b41-79d608daa07f tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:55.691765 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-480c7d33-9ee4-4469-8b41-79d608daa07f tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 1ee8133d-9ad2-4fa3-b02f-f1266acca98c] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:55.698416 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-480c7d33-9ee4-4469-8b41-79d608daa07f tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:55.698901 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-480c7d33-9ee4-4469-8b41-79d608daa07f tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:55.699340 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-480c7d33-9ee4-4469-8b41-79d608daa07f tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:55.700028 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-480c7d33-9ee4-4469-8b41-79d608daa07f tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:55.700487 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-480c7d33-9ee4-4469-8b41-79d608daa07f tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:55.700949 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-480c7d33-9ee4-4469-8b41-79d608daa07f tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:55.836013 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-480c7d33-9ee4-4469-8b41-79d608daa07f tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:55.843853 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-480c7d33-9ee4-4469-8b41-79d608daa07f tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c" status: 200 len: 1680 microversion: 2.1 time: 0.156530 Aug 24 03:41:55.844409 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 480/949] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:55 2022] GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:41:56.865427 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-299d594a-98be-4df8-99c2-845e7e39a594 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:56.866279 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-299d594a-98be-4df8-99c2-845e7e39a594 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 1ee8133d-9ad2-4fa3-b02f-f1266acca98c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:56.872756 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-299d594a-98be-4df8-99c2-845e7e39a594 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:56.873277 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-299d594a-98be-4df8-99c2-845e7e39a594 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:56.873717 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-299d594a-98be-4df8-99c2-845e7e39a594 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:56.874414 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-299d594a-98be-4df8-99c2-845e7e39a594 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:56.874875 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-299d594a-98be-4df8-99c2-845e7e39a594 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:56.875321 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-299d594a-98be-4df8-99c2-845e7e39a594 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:57.003054 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-299d594a-98be-4df8-99c2-845e7e39a594 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:57.011488 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-299d594a-98be-4df8-99c2-845e7e39a594 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c" status: 200 len: 1680 microversion: 2.1 time: 0.150438 Aug 24 03:41:57.012055 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 470/950] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:56 2022] GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:58.033615 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-0bb16820-6a88-4092-a0b1-f5d11c4c4905 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:58.034231 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-0bb16820-6a88-4092-a0b1-f5d11c4c4905 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 1ee8133d-9ad2-4fa3-b02f-f1266acca98c] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:58.041177 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0bb16820-6a88-4092-a0b1-f5d11c4c4905 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:58.041666 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0bb16820-6a88-4092-a0b1-f5d11c4c4905 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:58.042100 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0bb16820-6a88-4092-a0b1-f5d11c4c4905 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:58.042789 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0bb16820-6a88-4092-a0b1-f5d11c4c4905 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:58.043452 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0bb16820-6a88-4092-a0b1-f5d11c4c4905 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:58.043973 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0bb16820-6a88-4092-a0b1-f5d11c4c4905 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:58.267867 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-0bb16820-6a88-4092-a0b1-f5d11c4c4905 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fa457d74c644a3ad740da44576a12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b05b1de2f064ba29a6d0f7f4c8b2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:41:58.276346 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-0bb16820-6a88-4092-a0b1-f5d11c4c4905 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c" status: 200 len: 1613 microversion: 2.1 time: 0.246596 Aug 24 03:41:58.276965 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 481/951] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:58 2022] GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c => generated 1613 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:58.431797 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-85520079-8ccd-40ff-823f-17bbd1d6a09f req-83206609-52ec-4b36-aed7-5bc91de1671f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ee8133d-9ad2-4fa3-b02f-f1266acca98c", "name": "network-vif-deleted", "tag": "f5d61b9b-9e49-4c0a-9229-74a543762264"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:58.442321 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-85520079-8ccd-40ff-823f-17bbd1d6a09f req-83206609-52ec-4b36-aed7-5bc91de1671f service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:58.442811 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-85520079-8ccd-40ff-823f-17bbd1d6a09f req-83206609-52ec-4b36-aed7-5bc91de1671f service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:58.443798 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-85520079-8ccd-40ff-823f-17bbd1d6a09f req-83206609-52ec-4b36-aed7-5bc91de1671f service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:58.456149 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-85520079-8ccd-40ff-823f-17bbd1d6a09f req-83206609-52ec-4b36-aed7-5bc91de1671f service nova] Creating event network-vif-deleted:f5d61b9b-9e49-4c0a-9229-74a543762264 for instance 1ee8133d-9ad2-4fa3-b02f-f1266acca98c on hv-cinder-85426 Aug 24 03:41:58.462268 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-85520079-8ccd-40ff-823f-17bbd1d6a09f req-83206609-52ec-4b36-aed7-5bc91de1671f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034042 Aug 24 03:41:58.463326 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 471/952] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:59.298090 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-aaceec6e-5fb9-4ce6-853a-17d0e12361fc tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:59.298697 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-aaceec6e-5fb9-4ce6-853a-17d0e12361fc tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 1ee8133d-9ad2-4fa3-b02f-f1266acca98c] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:41:59.305938 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-aaceec6e-5fb9-4ce6-853a-17d0e12361fc tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:59.306366 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-aaceec6e-5fb9-4ce6-853a-17d0e12361fc tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:59.306801 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-aaceec6e-5fb9-4ce6-853a-17d0e12361fc tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:59.307493 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-aaceec6e-5fb9-4ce6-853a-17d0e12361fc tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:41:59.307946 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-aaceec6e-5fb9-4ce6-853a-17d0e12361fc tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:41:59.308375 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-aaceec6e-5fb9-4ce6-853a-17d0e12361fc tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:41:59.322204 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.wsgi [None req-aaceec6e-5fb9-4ce6-853a-17d0e12361fc tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] HTTP exception thrown: Instance 1ee8133d-9ad2-4fa3-b02f-f1266acca98c could not be found. Aug 24 03:41:59.323855 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-aaceec6e-5fb9-4ce6-853a-17d0e12361fc tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Request method failure captured: Aug 24 03:41:59.323855 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: request: GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c HTTP/1.1 Aug 24 03:41:59.323855 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept: application/json Aug 24 03:41:59.323855 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept-Encoding: identity Aug 24 03:41:59.323855 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Connection: close Aug 24 03:41:59.323855 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Length: 0 Aug 24 03:41:59.323855 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Type: application/json Aug 24 03:41:59.323855 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Host: 10.222.0.81 Aug 24 03:41:59.323855 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Openstack-System-Scope: None Aug 24 03:41:59.323855 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: User-Agent: python-urllib3/1.26.11 Aug 24 03:41:59.323855 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Auth-Token: gAAAAABjBZ0XgUUzqu8gYfTR5JQX5djiu9sm-YoBY9uX3hewM3ja7I-QxGErX1ku_wIHDECZdrppQollXQEV9Swedz4AIA8EAZxPt4bZAsmGPPzDLcGWKEKc4DE209NR03zPKRHuS4Do7t619MPq8qEyrIO2sytfgfnhiclpGeyn5wm_QNbkDu4 Aug 24 03:41:59.323855 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Id: None Aug 24 03:41:59.323855 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Name: None Aug 24 03:41:59.323855 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Identity-Status: Confirmed Aug 24 03:41:59.323855 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Is-Admin-Project: True Aug 24 03:41:59.323855 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Id: default Aug 24 03:41:59.323855 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Name: Default Aug 24 03:41:59.323855 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Id: 4b05b1de2f064ba29a6d0f7f4c8b2a01 Aug 24 03:41:59.323855 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Name: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:41:59.323855 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Role: reader,member Aug 24 03:41:59.323855 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Roles: reader,member Aug 24 03:41:59.325529 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_4b05b1de2f064ba29a6d0f7f4c8b2a01", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}] Aug 24 03:41:59.325529 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:41:59.325529 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Id: 4b05b1de2f064ba29a6d0f7f4c8b2a01 Aug 24 03:41:59.325529 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:41:59.325529 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User: tempest-AttachVolumeNegativeTest-1777736198-project Aug 24 03:41:59.325529 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Id: default Aug 24 03:41:59.325529 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Name: Default Aug 24 03:41:59.325529 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Id: e9fa457d74c644a3ad740da44576a12f Aug 24 03:41:59.325529 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Name: tempest-AttachVolumeNegativeTest-1777736198-project Aug 24 03:41:59.325529 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: method: > Aug 24 03:41:59.325529 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: exception: Instance 1ee8133d-9ad2-4fa3-b02f-f1266acca98c could not be found. Aug 24 03:41:59.325529 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: action_args: {'id': '1ee8133d-9ad2-4fa3-b02f-f1266acca98c'} Aug 24 03:41:59.326356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:41:59.326356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:59.326356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:41:59.326356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:41:59.326356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:41:59.326356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:41:59.326356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:41:59.326356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:41:59.326356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:41:59.326356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:41:59.326356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ee8133d-9ad2-4fa3-b02f-f1266acca98c could not be found. Aug 24 03:41:59.326356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:41:59.326356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:41:59.326356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:41:59.326356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:59.326356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:41:59.326356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:41:59.326356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:41:59.326356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:41:59.326356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:41:59.327869 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:41:59.327869 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:41:59.327869 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:41:59.327869 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:41:59.327869 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:41:59.327869 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:41:59.327869 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:41:59.327869 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ee8133d-9ad2-4fa3-b02f-f1266acca98c could not be found. Aug 24 03:41:59.327869 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:41:59.327869 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:41:59.327869 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:41:59.327869 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:59.327869 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:41:59.327869 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:41:59.327869 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:41:59.327869 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:41:59.327869 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ee8133d-9ad2-4fa3-b02f-f1266acca98c could not be found. Aug 24 03:41:59.327869 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:41:59.329416 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-aaceec6e-5fb9-4ce6-853a-17d0e12361fc tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Returning 404 to user: Instance 1ee8133d-9ad2-4fa3-b02f-f1266acca98c could not be found. {{(pid=120709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:41:59.329416 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-aaceec6e-5fb9-4ce6-853a-17d0e12361fc tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c" status: 404 len: 111 microversion: 2.1 time: 0.031154 Aug 24 03:41:59.329416 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 482/953] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:41:59 2022] GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:41:59.336453 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-273ac8df-f06b-417b-9edd-1c1f338baeb9 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '.version_select at 0x7f942f22d5e0>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:59.355021 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-273ac8df-f06b-417b-9edd-1c1f338baeb9 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-899419585" status: 202 len: 0 microversion: 2.1 time: 0.023983 Aug 24 03:41:59.355581 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 472/954] 10.222.0.81 () {58 vars in 1218 bytes} [Wed Aug 24 03:41:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-899419585 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:41:59.927169 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:41:59.928093 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Wed Aug 24 03:41:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:42:01.155750 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-4efc974c-7574-482b-822d-842481af4ebe tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:01.156281 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-4efc974c-7574-482b-822d-842481af4ebe tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 1ee8133d-9ad2-4fa3-b02f-f1266acca98c] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:01.163163 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4efc974c-7574-482b-822d-842481af4ebe tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:01.163597 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4efc974c-7574-482b-822d-842481af4ebe tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:01.164062 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4efc974c-7574-482b-822d-842481af4ebe tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:01.164811 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4efc974c-7574-482b-822d-842481af4ebe tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:01.165274 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4efc974c-7574-482b-822d-842481af4ebe tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:01.165701 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4efc974c-7574-482b-822d-842481af4ebe tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:01.178744 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.wsgi [None req-4efc974c-7574-482b-822d-842481af4ebe tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] HTTP exception thrown: Instance 1ee8133d-9ad2-4fa3-b02f-f1266acca98c could not be found. Aug 24 03:42:01.180279 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-4efc974c-7574-482b-822d-842481af4ebe tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Request method failure captured: Aug 24 03:42:01.180279 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: request: DELETE /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c HTTP/1.1 Aug 24 03:42:01.180279 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept: application/json Aug 24 03:42:01.180279 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept-Encoding: identity Aug 24 03:42:01.180279 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Connection: close Aug 24 03:42:01.180279 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Length: 0 Aug 24 03:42:01.180279 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Type: application/json Aug 24 03:42:01.180279 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Host: 10.222.0.81 Aug 24 03:42:01.180279 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Openstack-System-Scope: None Aug 24 03:42:01.180279 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: User-Agent: python-urllib3/1.26.11 Aug 24 03:42:01.180279 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Auth-Token: gAAAAABjBZ0XgUUzqu8gYfTR5JQX5djiu9sm-YoBY9uX3hewM3ja7I-QxGErX1ku_wIHDECZdrppQollXQEV9Swedz4AIA8EAZxPt4bZAsmGPPzDLcGWKEKc4DE209NR03zPKRHuS4Do7t619MPq8qEyrIO2sytfgfnhiclpGeyn5wm_QNbkDu4 Aug 24 03:42:01.180279 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Id: None Aug 24 03:42:01.180279 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Name: None Aug 24 03:42:01.180279 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Identity-Status: Confirmed Aug 24 03:42:01.180279 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Is-Admin-Project: True Aug 24 03:42:01.180279 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Id: default Aug 24 03:42:01.180279 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Name: Default Aug 24 03:42:01.180279 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Id: 4b05b1de2f064ba29a6d0f7f4c8b2a01 Aug 24 03:42:01.180279 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Name: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:42:01.180279 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Role: reader,member Aug 24 03:42:01.180279 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Roles: reader,member Aug 24 03:42:01.181901 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_4b05b1de2f064ba29a6d0f7f4c8b2a01", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}] Aug 24 03:42:01.181901 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:42:01.181901 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Id: 4b05b1de2f064ba29a6d0f7f4c8b2a01 Aug 24 03:42:01.181901 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:42:01.181901 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User: tempest-AttachVolumeNegativeTest-1777736198-project Aug 24 03:42:01.181901 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Id: default Aug 24 03:42:01.181901 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Name: Default Aug 24 03:42:01.181901 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Id: e9fa457d74c644a3ad740da44576a12f Aug 24 03:42:01.181901 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Name: tempest-AttachVolumeNegativeTest-1777736198-project Aug 24 03:42:01.181901 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: method: > Aug 24 03:42:01.181901 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: exception: Instance 1ee8133d-9ad2-4fa3-b02f-f1266acca98c could not be found. Aug 24 03:42:01.181901 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: action_args: {'id': '1ee8133d-9ad2-4fa3-b02f-f1266acca98c'} Aug 24 03:42:01.182736 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:42:01.182736 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:01.182736 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:42:01.182736 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:42:01.182736 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:42:01.182736 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:42:01.182736 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:42:01.182736 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:42:01.182736 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:42:01.182736 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:42:01.182736 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ee8133d-9ad2-4fa3-b02f-f1266acca98c could not be found. Aug 24 03:42:01.182736 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:42:01.182736 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:01.182736 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:42:01.182736 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:01.182736 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:01.182736 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:01.182736 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:42:01.182736 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:42:01.182736 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:42:01.184023 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:42:01.184023 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:42:01.184023 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:42:01.184023 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:42:01.184023 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:42:01.184023 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:42:01.184023 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:42:01.184023 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:42:01.184023 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:42:01.184023 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ee8133d-9ad2-4fa3-b02f-f1266acca98c could not be found. Aug 24 03:42:01.184023 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:42:01.184023 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:01.184023 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:42:01.184023 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:01.184023 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:01.184023 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:01.184023 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:42:01.184023 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:42:01.184023 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ee8133d-9ad2-4fa3-b02f-f1266acca98c could not be found. Aug 24 03:42:01.184023 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:42:01.185542 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-4efc974c-7574-482b-822d-842481af4ebe tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Returning 404 to user: Instance 1ee8133d-9ad2-4fa3-b02f-f1266acca98c could not be found. {{(pid=120709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:42:01.185542 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-4efc974c-7574-482b-822d-842481af4ebe tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "DELETE /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c" status: 404 len: 111 microversion: 2.1 time: 0.030093 Aug 24 03:42:01.185542 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 483/955] 10.222.0.81 () {58 vars in 1239 bytes} [Wed Aug 24 03:42:01 2022] DELETE /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:42:01.190701 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-5ffc81c2-1596-4b19-bc9a-c34e60b323a2 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:01.194230 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-5ffc81c2-1596-4b19-bc9a-c34e60b323a2 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 1ee8133d-9ad2-4fa3-b02f-f1266acca98c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:01.200213 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5ffc81c2-1596-4b19-bc9a-c34e60b323a2 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:01.200692 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5ffc81c2-1596-4b19-bc9a-c34e60b323a2 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:01.201158 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5ffc81c2-1596-4b19-bc9a-c34e60b323a2 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:01.201841 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5ffc81c2-1596-4b19-bc9a-c34e60b323a2 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:01.202288 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5ffc81c2-1596-4b19-bc9a-c34e60b323a2 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:01.202709 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-5ffc81c2-1596-4b19-bc9a-c34e60b323a2 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:01.216446 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-5ffc81c2-1596-4b19-bc9a-c34e60b323a2 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] HTTP exception thrown: Instance 1ee8133d-9ad2-4fa3-b02f-f1266acca98c could not be found. Aug 24 03:42:01.218065 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-5ffc81c2-1596-4b19-bc9a-c34e60b323a2 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Request method failure captured: Aug 24 03:42:01.218065 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c HTTP/1.1 Aug 24 03:42:01.218065 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 24 03:42:01.218065 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 24 03:42:01.218065 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Connection: close Aug 24 03:42:01.218065 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 24 03:42:01.218065 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 24 03:42:01.218065 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Host: 10.222.0.81 Aug 24 03:42:01.218065 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 24 03:42:01.218065 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.11 Aug 24 03:42:01.218065 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjBZ0XgUUzqu8gYfTR5JQX5djiu9sm-YoBY9uX3hewM3ja7I-QxGErX1ku_wIHDECZdrppQollXQEV9Swedz4AIA8EAZxPt4bZAsmGPPzDLcGWKEKc4DE209NR03zPKRHuS4Do7t619MPq8qEyrIO2sytfgfnhiclpGeyn5wm_QNbkDu4 Aug 24 03:42:01.218065 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 24 03:42:01.218065 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 24 03:42:01.218065 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 24 03:42:01.218065 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 24 03:42:01.218065 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 24 03:42:01.218065 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 24 03:42:01.218065 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Id: 4b05b1de2f064ba29a6d0f7f4c8b2a01 Aug 24 03:42:01.218065 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:42:01.218065 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 24 03:42:01.218065 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 24 03:42:01.219772 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_4b05b1de2f064ba29a6d0f7f4c8b2a01", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}] Aug 24 03:42:01.219772 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:42:01.219772 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 4b05b1de2f064ba29a6d0f7f4c8b2a01 Aug 24 03:42:01.219772 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:42:01.219772 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User: tempest-AttachVolumeNegativeTest-1777736198-project Aug 24 03:42:01.219772 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 24 03:42:01.219772 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 24 03:42:01.219772 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Id: e9fa457d74c644a3ad740da44576a12f Aug 24 03:42:01.219772 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-AttachVolumeNegativeTest-1777736198-project Aug 24 03:42:01.219772 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: method: > Aug 24 03:42:01.219772 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: exception: Instance 1ee8133d-9ad2-4fa3-b02f-f1266acca98c could not be found. Aug 24 03:42:01.219772 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: action_args: {'id': '1ee8133d-9ad2-4fa3-b02f-f1266acca98c'} Aug 24 03:42:01.220720 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:42:01.220720 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:01.220720 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:42:01.220720 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:42:01.220720 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:42:01.220720 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:42:01.220720 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:42:01.220720 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:42:01.220720 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:42:01.220720 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:42:01.220720 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ee8133d-9ad2-4fa3-b02f-f1266acca98c could not be found. Aug 24 03:42:01.220720 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:42:01.220720 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:01.220720 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:42:01.220720 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:01.220720 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:01.220720 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:01.220720 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:42:01.220720 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:42:01.220720 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:42:01.222255 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:42:01.222255 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:42:01.222255 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:42:01.222255 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:42:01.222255 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:42:01.222255 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:42:01.222255 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:42:01.222255 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ee8133d-9ad2-4fa3-b02f-f1266acca98c could not be found. Aug 24 03:42:01.222255 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:42:01.222255 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:01.222255 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:42:01.222255 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:01.222255 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:01.222255 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:01.222255 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:42:01.222255 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:42:01.222255 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ee8133d-9ad2-4fa3-b02f-f1266acca98c could not be found. Aug 24 03:42:01.222255 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:42:01.223525 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-5ffc81c2-1596-4b19-bc9a-c34e60b323a2 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Returning 404 to user: Instance 1ee8133d-9ad2-4fa3-b02f-f1266acca98c could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:42:01.223525 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-5ffc81c2-1596-4b19-bc9a-c34e60b323a2 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c" status: 404 len: 111 microversion: 2.1 time: 0.033147 Aug 24 03:42:01.223525 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 473/956] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:01 2022] GET /compute/v2.1/servers/1ee8133d-9ad2-4fa3-b02f-f1266acca98c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:42:02.358418 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-5ea598a2-dea9-44c2-a417-dcbb74640751 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:02.358918 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-5ea598a2-dea9-44c2-a417-dcbb74640751 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 58eaad0c-bee5-46ff-b47a-eb93875c7dff] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:02.366323 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5ea598a2-dea9-44c2-a417-dcbb74640751 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:02.366816 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5ea598a2-dea9-44c2-a417-dcbb74640751 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:02.367257 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5ea598a2-dea9-44c2-a417-dcbb74640751 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:02.367948 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5ea598a2-dea9-44c2-a417-dcbb74640751 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:02.368400 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5ea598a2-dea9-44c2-a417-dcbb74640751 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:02.368866 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-5ea598a2-dea9-44c2-a417-dcbb74640751 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:02.382125 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.wsgi [None req-5ea598a2-dea9-44c2-a417-dcbb74640751 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] HTTP exception thrown: Instance 58eaad0c-bee5-46ff-b47a-eb93875c7dff could not be found. Aug 24 03:42:02.383647 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-5ea598a2-dea9-44c2-a417-dcbb74640751 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Request method failure captured: Aug 24 03:42:02.383647 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: request: DELETE /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff HTTP/1.1 Aug 24 03:42:02.383647 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept: application/json Aug 24 03:42:02.383647 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept-Encoding: identity Aug 24 03:42:02.383647 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Connection: close Aug 24 03:42:02.383647 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Length: 0 Aug 24 03:42:02.383647 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Type: application/json Aug 24 03:42:02.383647 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Host: 10.222.0.81 Aug 24 03:42:02.383647 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Openstack-System-Scope: None Aug 24 03:42:02.383647 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: User-Agent: python-urllib3/1.26.11 Aug 24 03:42:02.383647 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Auth-Token: gAAAAABjBZ0XgUUzqu8gYfTR5JQX5djiu9sm-YoBY9uX3hewM3ja7I-QxGErX1ku_wIHDECZdrppQollXQEV9Swedz4AIA8EAZxPt4bZAsmGPPzDLcGWKEKc4DE209NR03zPKRHuS4Do7t619MPq8qEyrIO2sytfgfnhiclpGeyn5wm_QNbkDu4 Aug 24 03:42:02.383647 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Id: None Aug 24 03:42:02.383647 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Name: None Aug 24 03:42:02.383647 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Identity-Status: Confirmed Aug 24 03:42:02.383647 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Is-Admin-Project: True Aug 24 03:42:02.383647 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Id: default Aug 24 03:42:02.383647 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Name: Default Aug 24 03:42:02.383647 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Id: 4b05b1de2f064ba29a6d0f7f4c8b2a01 Aug 24 03:42:02.383647 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Name: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:42:02.383647 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Role: reader,member Aug 24 03:42:02.383647 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Roles: reader,member Aug 24 03:42:02.385030 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_4b05b1de2f064ba29a6d0f7f4c8b2a01", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}] Aug 24 03:42:02.385030 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:42:02.385030 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Id: 4b05b1de2f064ba29a6d0f7f4c8b2a01 Aug 24 03:42:02.385030 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:42:02.385030 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User: tempest-AttachVolumeNegativeTest-1777736198-project Aug 24 03:42:02.385030 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Id: default Aug 24 03:42:02.385030 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Name: Default Aug 24 03:42:02.385030 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Id: e9fa457d74c644a3ad740da44576a12f Aug 24 03:42:02.385030 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Name: tempest-AttachVolumeNegativeTest-1777736198-project Aug 24 03:42:02.385030 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: method: > Aug 24 03:42:02.385030 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: exception: Instance 58eaad0c-bee5-46ff-b47a-eb93875c7dff could not be found. Aug 24 03:42:02.385030 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: action_args: {'id': '58eaad0c-bee5-46ff-b47a-eb93875c7dff'} Aug 24 03:42:02.385878 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:42:02.385878 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:02.385878 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:42:02.385878 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:42:02.385878 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:42:02.385878 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:42:02.385878 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:42:02.385878 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:42:02.385878 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:42:02.385878 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:42:02.385878 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58eaad0c-bee5-46ff-b47a-eb93875c7dff could not be found. Aug 24 03:42:02.385878 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:42:02.385878 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:02.385878 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:42:02.385878 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:02.385878 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:02.385878 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:02.385878 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:42:02.385878 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:42:02.385878 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:42:02.387442 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:42:02.387442 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:42:02.387442 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:42:02.387442 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:42:02.387442 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:42:02.387442 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:42:02.387442 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:42:02.387442 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:42:02.387442 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:42:02.387442 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58eaad0c-bee5-46ff-b47a-eb93875c7dff could not be found. Aug 24 03:42:02.387442 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:42:02.387442 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:02.387442 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:42:02.387442 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:02.387442 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:02.387442 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:02.387442 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:42:02.387442 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:42:02.387442 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58eaad0c-bee5-46ff-b47a-eb93875c7dff could not be found. Aug 24 03:42:02.387442 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:42:02.389071 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-5ea598a2-dea9-44c2-a417-dcbb74640751 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Returning 404 to user: Instance 58eaad0c-bee5-46ff-b47a-eb93875c7dff could not be found. {{(pid=120709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:42:02.389071 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-5ea598a2-dea9-44c2-a417-dcbb74640751 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "DELETE /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff" status: 404 len: 111 microversion: 2.1 time: 0.030378 Aug 24 03:42:02.389071 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 484/957] 10.222.0.81 () {58 vars in 1239 bytes} [Wed Aug 24 03:42:02 2022] DELETE /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:42:02.393406 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4878789e-49e9-4f96-8c94-1baf3963d299 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:02.394055 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-4878789e-49e9-4f96-8c94-1baf3963d299 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 58eaad0c-bee5-46ff-b47a-eb93875c7dff] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:02.400980 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4878789e-49e9-4f96-8c94-1baf3963d299 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:02.401471 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4878789e-49e9-4f96-8c94-1baf3963d299 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:02.401909 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4878789e-49e9-4f96-8c94-1baf3963d299 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:02.402607 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4878789e-49e9-4f96-8c94-1baf3963d299 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:02.403065 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4878789e-49e9-4f96-8c94-1baf3963d299 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:02.403494 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4878789e-49e9-4f96-8c94-1baf3963d299 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:02.417573 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-4878789e-49e9-4f96-8c94-1baf3963d299 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] HTTP exception thrown: Instance 58eaad0c-bee5-46ff-b47a-eb93875c7dff could not be found. Aug 24 03:42:02.419122 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4878789e-49e9-4f96-8c94-1baf3963d299 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Request method failure captured: Aug 24 03:42:02.419122 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff HTTP/1.1 Aug 24 03:42:02.419122 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 24 03:42:02.419122 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 24 03:42:02.419122 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Connection: close Aug 24 03:42:02.419122 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 24 03:42:02.419122 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 24 03:42:02.419122 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Host: 10.222.0.81 Aug 24 03:42:02.419122 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 24 03:42:02.419122 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.11 Aug 24 03:42:02.419122 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjBZ0XgUUzqu8gYfTR5JQX5djiu9sm-YoBY9uX3hewM3ja7I-QxGErX1ku_wIHDECZdrppQollXQEV9Swedz4AIA8EAZxPt4bZAsmGPPzDLcGWKEKc4DE209NR03zPKRHuS4Do7t619MPq8qEyrIO2sytfgfnhiclpGeyn5wm_QNbkDu4 Aug 24 03:42:02.419122 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 24 03:42:02.419122 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 24 03:42:02.419122 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 24 03:42:02.419122 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 24 03:42:02.419122 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 24 03:42:02.419122 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 24 03:42:02.419122 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Id: 4b05b1de2f064ba29a6d0f7f4c8b2a01 Aug 24 03:42:02.419122 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:42:02.419122 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 24 03:42:02.419122 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 24 03:42:02.420656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_4b05b1de2f064ba29a6d0f7f4c8b2a01", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}] Aug 24 03:42:02.420656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:42:02.420656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 4b05b1de2f064ba29a6d0f7f4c8b2a01 Aug 24 03:42:02.420656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:42:02.420656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User: tempest-AttachVolumeNegativeTest-1777736198-project Aug 24 03:42:02.420656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 24 03:42:02.420656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 24 03:42:02.420656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Id: e9fa457d74c644a3ad740da44576a12f Aug 24 03:42:02.420656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-AttachVolumeNegativeTest-1777736198-project Aug 24 03:42:02.420656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: method: > Aug 24 03:42:02.420656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: exception: Instance 58eaad0c-bee5-46ff-b47a-eb93875c7dff could not be found. Aug 24 03:42:02.420656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: action_args: {'id': '58eaad0c-bee5-46ff-b47a-eb93875c7dff'} Aug 24 03:42:02.421427 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:42:02.421427 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:02.421427 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:42:02.421427 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:42:02.421427 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:42:02.421427 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:42:02.421427 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:42:02.421427 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:42:02.421427 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:42:02.421427 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:42:02.421427 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58eaad0c-bee5-46ff-b47a-eb93875c7dff could not be found. Aug 24 03:42:02.421427 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:42:02.421427 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:02.421427 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:42:02.421427 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:02.421427 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:02.421427 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:02.421427 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:42:02.421427 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:42:02.421427 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:42:02.422613 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:42:02.422613 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:42:02.422613 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:42:02.422613 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:42:02.422613 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:42:02.422613 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:42:02.422613 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:42:02.422613 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58eaad0c-bee5-46ff-b47a-eb93875c7dff could not be found. Aug 24 03:42:02.422613 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:42:02.422613 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:02.422613 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:42:02.422613 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:02.422613 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:02.422613 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:02.422613 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:42:02.422613 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:42:02.422613 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58eaad0c-bee5-46ff-b47a-eb93875c7dff could not be found. Aug 24 03:42:02.422613 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:42:02.423769 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4878789e-49e9-4f96-8c94-1baf3963d299 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Returning 404 to user: Instance 58eaad0c-bee5-46ff-b47a-eb93875c7dff could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:42:02.423769 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4878789e-49e9-4f96-8c94-1baf3963d299 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff" status: 404 len: 111 microversion: 2.1 time: 0.030989 Aug 24 03:42:02.423769 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 474/958] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:02 2022] GET /compute/v2.1/servers/58eaad0c-bee5-46ff-b47a-eb93875c7dff => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:42:02.429697 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-8f4e6e2d-805d-492d-a97e-717ba4920874 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:02.430193 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-8f4e6e2d-805d-492d-a97e-717ba4920874 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: f97627fb-1853-4f70-a2be-00724183986c] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:02.436056 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8f4e6e2d-805d-492d-a97e-717ba4920874 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:02.436553 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8f4e6e2d-805d-492d-a97e-717ba4920874 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:02.437012 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8f4e6e2d-805d-492d-a97e-717ba4920874 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:02.437705 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8f4e6e2d-805d-492d-a97e-717ba4920874 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:02.438157 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8f4e6e2d-805d-492d-a97e-717ba4920874 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:02.438580 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8f4e6e2d-805d-492d-a97e-717ba4920874 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:02.451654 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.wsgi [None req-8f4e6e2d-805d-492d-a97e-717ba4920874 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] HTTP exception thrown: Instance f97627fb-1853-4f70-a2be-00724183986c could not be found. Aug 24 03:42:02.453202 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-8f4e6e2d-805d-492d-a97e-717ba4920874 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Request method failure captured: Aug 24 03:42:02.453202 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: request: DELETE /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c HTTP/1.1 Aug 24 03:42:02.453202 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept: application/json Aug 24 03:42:02.453202 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept-Encoding: identity Aug 24 03:42:02.453202 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Connection: close Aug 24 03:42:02.453202 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Length: 0 Aug 24 03:42:02.453202 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Type: application/json Aug 24 03:42:02.453202 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Host: 10.222.0.81 Aug 24 03:42:02.453202 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Openstack-System-Scope: None Aug 24 03:42:02.453202 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: User-Agent: python-urllib3/1.26.11 Aug 24 03:42:02.453202 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Auth-Token: gAAAAABjBZ0XgUUzqu8gYfTR5JQX5djiu9sm-YoBY9uX3hewM3ja7I-QxGErX1ku_wIHDECZdrppQollXQEV9Swedz4AIA8EAZxPt4bZAsmGPPzDLcGWKEKc4DE209NR03zPKRHuS4Do7t619MPq8qEyrIO2sytfgfnhiclpGeyn5wm_QNbkDu4 Aug 24 03:42:02.453202 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Id: None Aug 24 03:42:02.453202 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Name: None Aug 24 03:42:02.453202 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Identity-Status: Confirmed Aug 24 03:42:02.453202 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Is-Admin-Project: True Aug 24 03:42:02.453202 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Id: default Aug 24 03:42:02.453202 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Name: Default Aug 24 03:42:02.453202 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Id: 4b05b1de2f064ba29a6d0f7f4c8b2a01 Aug 24 03:42:02.453202 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Name: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:42:02.453202 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Role: reader,member Aug 24 03:42:02.453202 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Roles: reader,member Aug 24 03:42:02.454766 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_4b05b1de2f064ba29a6d0f7f4c8b2a01", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}] Aug 24 03:42:02.454766 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:42:02.454766 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Id: 4b05b1de2f064ba29a6d0f7f4c8b2a01 Aug 24 03:42:02.454766 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:42:02.454766 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User: tempest-AttachVolumeNegativeTest-1777736198-project Aug 24 03:42:02.454766 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Id: default Aug 24 03:42:02.454766 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Name: Default Aug 24 03:42:02.454766 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Id: e9fa457d74c644a3ad740da44576a12f Aug 24 03:42:02.454766 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Name: tempest-AttachVolumeNegativeTest-1777736198-project Aug 24 03:42:02.454766 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: method: > Aug 24 03:42:02.454766 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: exception: Instance f97627fb-1853-4f70-a2be-00724183986c could not be found. Aug 24 03:42:02.454766 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: action_args: {'id': 'f97627fb-1853-4f70-a2be-00724183986c'} Aug 24 03:42:02.455753 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:42:02.455753 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:02.455753 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:42:02.455753 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:42:02.455753 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:42:02.455753 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:42:02.455753 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:42:02.455753 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:42:02.455753 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:42:02.455753 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:42:02.455753 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f97627fb-1853-4f70-a2be-00724183986c could not be found. Aug 24 03:42:02.455753 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:42:02.455753 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:02.455753 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:42:02.455753 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:02.455753 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:02.455753 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:02.455753 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:42:02.455753 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:42:02.455753 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:42:02.457239 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:42:02.457239 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:42:02.457239 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:42:02.457239 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:42:02.457239 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:42:02.457239 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:42:02.457239 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:42:02.457239 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:42:02.457239 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:42:02.457239 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f97627fb-1853-4f70-a2be-00724183986c could not be found. Aug 24 03:42:02.457239 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:42:02.457239 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:02.457239 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:42:02.457239 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:02.457239 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:02.457239 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:02.457239 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:42:02.457239 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:42:02.457239 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f97627fb-1853-4f70-a2be-00724183986c could not be found. Aug 24 03:42:02.457239 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:42:02.458955 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-8f4e6e2d-805d-492d-a97e-717ba4920874 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Returning 404 to user: Instance f97627fb-1853-4f70-a2be-00724183986c could not be found. {{(pid=120709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:42:02.458955 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-8f4e6e2d-805d-492d-a97e-717ba4920874 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "DELETE /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c" status: 404 len: 111 microversion: 2.1 time: 0.029406 Aug 24 03:42:02.458955 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 485/959] 10.222.0.81 () {58 vars in 1239 bytes} [Wed Aug 24 03:42:02 2022] DELETE /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:42:02.463201 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-8423827e-2583-453b-999c-e737e779091b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:02.463815 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-8423827e-2583-453b-999c-e737e779091b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: f97627fb-1853-4f70-a2be-00724183986c] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:02.470197 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8423827e-2583-453b-999c-e737e779091b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:02.470677 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8423827e-2583-453b-999c-e737e779091b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:02.471109 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8423827e-2583-453b-999c-e737e779091b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:02.471820 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8423827e-2583-453b-999c-e737e779091b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:02.472268 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8423827e-2583-453b-999c-e737e779091b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:02.472691 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-8423827e-2583-453b-999c-e737e779091b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:02.487764 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-8423827e-2583-453b-999c-e737e779091b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] HTTP exception thrown: Instance f97627fb-1853-4f70-a2be-00724183986c could not be found. Aug 24 03:42:02.489422 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-8423827e-2583-453b-999c-e737e779091b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Request method failure captured: Aug 24 03:42:02.489422 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c HTTP/1.1 Aug 24 03:42:02.489422 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 24 03:42:02.489422 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 24 03:42:02.489422 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Connection: close Aug 24 03:42:02.489422 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 24 03:42:02.489422 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 24 03:42:02.489422 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Host: 10.222.0.81 Aug 24 03:42:02.489422 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 24 03:42:02.489422 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.11 Aug 24 03:42:02.489422 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjBZ0XgUUzqu8gYfTR5JQX5djiu9sm-YoBY9uX3hewM3ja7I-QxGErX1ku_wIHDECZdrppQollXQEV9Swedz4AIA8EAZxPt4bZAsmGPPzDLcGWKEKc4DE209NR03zPKRHuS4Do7t619MPq8qEyrIO2sytfgfnhiclpGeyn5wm_QNbkDu4 Aug 24 03:42:02.489422 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 24 03:42:02.489422 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 24 03:42:02.489422 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 24 03:42:02.489422 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 24 03:42:02.489422 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 24 03:42:02.489422 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 24 03:42:02.489422 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Id: 4b05b1de2f064ba29a6d0f7f4c8b2a01 Aug 24 03:42:02.489422 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:42:02.489422 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 24 03:42:02.489422 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 24 03:42:02.491570 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_4b05b1de2f064ba29a6d0f7f4c8b2a01", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}] Aug 24 03:42:02.491570 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:42:02.491570 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 4b05b1de2f064ba29a6d0f7f4c8b2a01 Aug 24 03:42:02.491570 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:42:02.491570 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User: tempest-AttachVolumeNegativeTest-1777736198-project Aug 24 03:42:02.491570 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 24 03:42:02.491570 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 24 03:42:02.491570 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Id: e9fa457d74c644a3ad740da44576a12f Aug 24 03:42:02.491570 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-AttachVolumeNegativeTest-1777736198-project Aug 24 03:42:02.491570 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: method: > Aug 24 03:42:02.491570 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: exception: Instance f97627fb-1853-4f70-a2be-00724183986c could not be found. Aug 24 03:42:02.491570 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: action_args: {'id': 'f97627fb-1853-4f70-a2be-00724183986c'} Aug 24 03:42:02.492356 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:42:02.492356 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:02.492356 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:42:02.492356 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:42:02.492356 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:42:02.492356 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:42:02.492356 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:42:02.492356 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:42:02.492356 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:42:02.492356 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:42:02.492356 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f97627fb-1853-4f70-a2be-00724183986c could not be found. Aug 24 03:42:02.492356 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:42:02.492356 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:02.492356 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:42:02.492356 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:02.492356 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:02.492356 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:02.492356 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:42:02.492356 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:42:02.492356 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:42:02.493902 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:42:02.493902 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:42:02.493902 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:42:02.493902 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:42:02.493902 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:42:02.493902 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:42:02.493902 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:42:02.493902 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f97627fb-1853-4f70-a2be-00724183986c could not be found. Aug 24 03:42:02.493902 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:42:02.493902 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:02.493902 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:42:02.493902 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:02.493902 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:02.493902 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:02.493902 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:42:02.493902 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:42:02.493902 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f97627fb-1853-4f70-a2be-00724183986c could not be found. Aug 24 03:42:02.493902 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:42:02.495404 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-8423827e-2583-453b-999c-e737e779091b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Returning 404 to user: Instance f97627fb-1853-4f70-a2be-00724183986c could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:42:02.495404 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-8423827e-2583-453b-999c-e737e779091b tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c" status: 404 len: 111 microversion: 2.1 time: 0.032406 Aug 24 03:42:02.495404 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 475/960] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:02 2022] GET /compute/v2.1/servers/f97627fb-1853-4f70-a2be-00724183986c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:42:03.633089 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-ce634ef9-739d-4bbb-8b1e-9bdf59052dd0 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:03.633595 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-ce634ef9-739d-4bbb-8b1e-9bdf59052dd0 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 3a493863-6fda-4311-8271-48f093698726] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:03.639843 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ce634ef9-739d-4bbb-8b1e-9bdf59052dd0 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:03.640328 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ce634ef9-739d-4bbb-8b1e-9bdf59052dd0 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:03.640790 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ce634ef9-739d-4bbb-8b1e-9bdf59052dd0 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:03.641483 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ce634ef9-739d-4bbb-8b1e-9bdf59052dd0 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:03.641938 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ce634ef9-739d-4bbb-8b1e-9bdf59052dd0 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:03.642360 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ce634ef9-739d-4bbb-8b1e-9bdf59052dd0 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:03.656066 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.wsgi [None req-ce634ef9-739d-4bbb-8b1e-9bdf59052dd0 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] HTTP exception thrown: Instance 3a493863-6fda-4311-8271-48f093698726 could not be found. Aug 24 03:42:03.657628 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-ce634ef9-739d-4bbb-8b1e-9bdf59052dd0 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Request method failure captured: Aug 24 03:42:03.657628 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: request: DELETE /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726 HTTP/1.1 Aug 24 03:42:03.657628 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept: application/json Aug 24 03:42:03.657628 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept-Encoding: identity Aug 24 03:42:03.657628 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Connection: close Aug 24 03:42:03.657628 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Length: 0 Aug 24 03:42:03.657628 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Type: application/json Aug 24 03:42:03.657628 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Host: 10.222.0.81 Aug 24 03:42:03.657628 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Openstack-System-Scope: None Aug 24 03:42:03.657628 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: User-Agent: python-urllib3/1.26.11 Aug 24 03:42:03.657628 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Auth-Token: gAAAAABjBZ0XgUUzqu8gYfTR5JQX5djiu9sm-YoBY9uX3hewM3ja7I-QxGErX1ku_wIHDECZdrppQollXQEV9Swedz4AIA8EAZxPt4bZAsmGPPzDLcGWKEKc4DE209NR03zPKRHuS4Do7t619MPq8qEyrIO2sytfgfnhiclpGeyn5wm_QNbkDu4 Aug 24 03:42:03.657628 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Id: None Aug 24 03:42:03.657628 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Name: None Aug 24 03:42:03.657628 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Identity-Status: Confirmed Aug 24 03:42:03.657628 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Is-Admin-Project: True Aug 24 03:42:03.657628 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Id: default Aug 24 03:42:03.657628 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Name: Default Aug 24 03:42:03.657628 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Id: 4b05b1de2f064ba29a6d0f7f4c8b2a01 Aug 24 03:42:03.657628 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Name: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:42:03.657628 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Role: reader,member Aug 24 03:42:03.657628 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Roles: reader,member Aug 24 03:42:03.659153 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_4b05b1de2f064ba29a6d0f7f4c8b2a01", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}] Aug 24 03:42:03.659153 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:42:03.659153 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Id: 4b05b1de2f064ba29a6d0f7f4c8b2a01 Aug 24 03:42:03.659153 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:42:03.659153 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User: tempest-AttachVolumeNegativeTest-1777736198-project Aug 24 03:42:03.659153 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Id: default Aug 24 03:42:03.659153 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Name: Default Aug 24 03:42:03.659153 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Id: e9fa457d74c644a3ad740da44576a12f Aug 24 03:42:03.659153 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Name: tempest-AttachVolumeNegativeTest-1777736198-project Aug 24 03:42:03.659153 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: method: > Aug 24 03:42:03.659153 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: exception: Instance 3a493863-6fda-4311-8271-48f093698726 could not be found. Aug 24 03:42:03.659153 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: action_args: {'id': '3a493863-6fda-4311-8271-48f093698726'} Aug 24 03:42:03.660063 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:42:03.660063 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:03.660063 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:42:03.660063 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:42:03.660063 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:42:03.660063 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:42:03.660063 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:42:03.660063 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:42:03.660063 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:42:03.660063 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:42:03.660063 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a493863-6fda-4311-8271-48f093698726 could not be found. Aug 24 03:42:03.660063 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:42:03.660063 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:03.660063 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:42:03.660063 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:03.660063 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:03.660063 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:03.660063 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:42:03.660063 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:42:03.660063 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:42:03.661556 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:42:03.661556 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:42:03.661556 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:42:03.661556 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:42:03.661556 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:42:03.661556 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:42:03.661556 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:42:03.661556 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:42:03.661556 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:42:03.661556 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a493863-6fda-4311-8271-48f093698726 could not be found. Aug 24 03:42:03.661556 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:42:03.661556 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:03.661556 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:42:03.661556 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:03.661556 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:03.661556 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:03.661556 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:42:03.661556 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:42:03.661556 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a493863-6fda-4311-8271-48f093698726 could not be found. Aug 24 03:42:03.661556 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:42:03.663541 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-ce634ef9-739d-4bbb-8b1e-9bdf59052dd0 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Returning 404 to user: Instance 3a493863-6fda-4311-8271-48f093698726 could not be found. {{(pid=120709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:42:03.663541 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-ce634ef9-739d-4bbb-8b1e-9bdf59052dd0 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "DELETE /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726" status: 404 len: 111 microversion: 2.1 time: 0.030276 Aug 24 03:42:03.663541 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 486/961] 10.222.0.81 () {58 vars in 1239 bytes} [Wed Aug 24 03:42:03 2022] DELETE /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:42:03.668209 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b7e58323-4db8-4c92-b7d5-f07f6d1222d1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:03.668866 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-b7e58323-4db8-4c92-b7d5-f07f6d1222d1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] [instance: 3a493863-6fda-4311-8271-48f093698726] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:42:03.675270 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b7e58323-4db8-4c92-b7d5-f07f6d1222d1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:03.675792 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b7e58323-4db8-4c92-b7d5-f07f6d1222d1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:03.676233 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b7e58323-4db8-4c92-b7d5-f07f6d1222d1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:03.676966 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b7e58323-4db8-4c92-b7d5-f07f6d1222d1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:42:03.677615 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b7e58323-4db8-4c92-b7d5-f07f6d1222d1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:42:03.678071 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b7e58323-4db8-4c92-b7d5-f07f6d1222d1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:42:03.691357 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-b7e58323-4db8-4c92-b7d5-f07f6d1222d1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] HTTP exception thrown: Instance 3a493863-6fda-4311-8271-48f093698726 could not be found. Aug 24 03:42:03.692828 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b7e58323-4db8-4c92-b7d5-f07f6d1222d1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Request method failure captured: Aug 24 03:42:03.692828 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726 HTTP/1.1 Aug 24 03:42:03.692828 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 24 03:42:03.692828 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 24 03:42:03.692828 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Connection: close Aug 24 03:42:03.692828 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 24 03:42:03.692828 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 24 03:42:03.692828 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Host: 10.222.0.81 Aug 24 03:42:03.692828 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 24 03:42:03.692828 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.11 Aug 24 03:42:03.692828 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjBZ0XgUUzqu8gYfTR5JQX5djiu9sm-YoBY9uX3hewM3ja7I-QxGErX1ku_wIHDECZdrppQollXQEV9Swedz4AIA8EAZxPt4bZAsmGPPzDLcGWKEKc4DE209NR03zPKRHuS4Do7t619MPq8qEyrIO2sytfgfnhiclpGeyn5wm_QNbkDu4 Aug 24 03:42:03.692828 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 24 03:42:03.692828 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 24 03:42:03.692828 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 24 03:42:03.692828 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 24 03:42:03.692828 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 24 03:42:03.692828 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 24 03:42:03.692828 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Id: 4b05b1de2f064ba29a6d0f7f4c8b2a01 Aug 24 03:42:03.692828 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:42:03.692828 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 24 03:42:03.692828 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 24 03:42:03.694926 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_4b05b1de2f064ba29a6d0f7f4c8b2a01", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/4b05b1de2f064ba29a6d0f7f4c8b2a01"}]}] Aug 24 03:42:03.694926 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:42:03.694926 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Id: 4b05b1de2f064ba29a6d0f7f4c8b2a01 Aug 24 03:42:03.694926 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1777736198 Aug 24 03:42:03.694926 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User: tempest-AttachVolumeNegativeTest-1777736198-project Aug 24 03:42:03.694926 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 24 03:42:03.694926 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 24 03:42:03.694926 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Id: e9fa457d74c644a3ad740da44576a12f Aug 24 03:42:03.694926 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-AttachVolumeNegativeTest-1777736198-project Aug 24 03:42:03.694926 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: method: > Aug 24 03:42:03.694926 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: exception: Instance 3a493863-6fda-4311-8271-48f093698726 could not be found. Aug 24 03:42:03.694926 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: action_args: {'id': '3a493863-6fda-4311-8271-48f093698726'} Aug 24 03:42:03.695962 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:42:03.695962 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:03.695962 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:42:03.695962 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:42:03.695962 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:42:03.695962 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:42:03.695962 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:42:03.695962 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:42:03.695962 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:42:03.695962 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:42:03.695962 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a493863-6fda-4311-8271-48f093698726 could not be found. Aug 24 03:42:03.695962 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:42:03.695962 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:03.695962 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:42:03.695962 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:03.695962 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:03.695962 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:03.695962 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:42:03.695962 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:42:03.695962 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:42:03.697446 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:42:03.697446 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:42:03.697446 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:42:03.697446 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:42:03.697446 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:42:03.697446 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:42:03.697446 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:42:03.697446 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a493863-6fda-4311-8271-48f093698726 could not be found. Aug 24 03:42:03.697446 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:42:03.697446 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:42:03.697446 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:42:03.697446 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:42:03.697446 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:42:03.697446 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:42:03.697446 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:42:03.697446 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:42:03.697446 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a493863-6fda-4311-8271-48f093698726 could not be found. Aug 24 03:42:03.697446 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:42:03.698854 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b7e58323-4db8-4c92-b7d5-f07f6d1222d1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] Returning 404 to user: Instance 3a493863-6fda-4311-8271-48f093698726 could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:42:03.698854 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-b7e58323-4db8-4c92-b7d5-f07f6d1222d1 tempest-AttachVolumeNegativeTest-1777736198 tempest-AttachVolumeNegativeTest-1777736198-project] 10.222.0.81 "GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726" status: 404 len: 111 microversion: 2.1 time: 0.030476 Aug 24 03:42:03.698854 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 476/962] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:42:03 2022] GET /compute/v2.1/servers/3a493863-6fda-4311-8271-48f093698726 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:43:03.930259 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_api:SELECT=20 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:03.931505 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:04.132976 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-6087f917-27ee-41c1-bd2b-90787c7d8e90 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Action: 'create', calling method: .version_select at 0x7f942f24f4c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1735211970", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgeFZgjg2hohn8bsf3bBfJ6YHNS0g8JxamYtj4SsDVrpCsv0HStrXD+9MQi6Ev9qYHP6yKw20GLLepBzAljbOh/qoX7g8obIgTJvy6Q0MC8EksgrPMGZqsZaLIo29p31g=="}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:04.149348 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.quota [None req-6087f917-27ee-41c1-bd2b-90787c7d8e90 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Getting quotas for project c742ff2fa942409384b6294cf883ce0a. Resources: {'key_pairs'} {{(pid=120709) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:43:04.153467 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.quota [None req-6087f917-27ee-41c1-bd2b-90787c7d8e90 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Getting quotas for user d32bf7e9512f4a51ae52a25bba18b891 and project c742ff2fa942409384b6294cf883ce0a. Resources: {'key_pairs'} {{(pid=120709) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:43:04.177907 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-6087f917-27ee-41c1-bd2b-90787c7d8e90 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.251298 Aug 24 03:43:04.178496 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 487/963] 10.222.0.81 () {60 vars in 1159 bytes} [Wed Aug 24 03:43:03 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:43:20.496332 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:20.497128 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:20.501269 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-d02ead4a-3526-4999-b19a-5572ed9ad5ec tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1983303210", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1735211970", "security_groups": [{"name": "tempest-secgroup-smoke-573258359"}], "block_device_mapping_v2": [{"uuid": "ccb02d81-9180-44e0-bb43-0e38e18c61aa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a77328d1-9351-48c2-a2f3-0639347291ff"}]}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:20.614379 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.network.neutron [None req-d02ead4a-3526-4999-b19a-5572ed9ad5ec tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] validate_networks() for [('a77328d1-9351-48c2-a2f3-0639347291ff', None, None, None, None, None)] {{(pid=120708) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:43:21.085751 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-d02ead4a-3526-4999-b19a-5572ed9ad5ec tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Flavor limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:43:21.086183 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-d02ead4a-3526-4999-b19a-5572ed9ad5ec tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Image limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:43:21.086656 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-d02ead4a-3526-4999-b19a-5572ed9ad5ec tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Flavor pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:43:21.087068 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-d02ead4a-3526-4999-b19a-5572ed9ad5ec tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Image pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:43:21.087763 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-d02ead4a-3526-4999-b19a-5572ed9ad5ec tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:43:21.096508 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d02ead4a-3526-4999-b19a-5572ed9ad5ec tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:21.097046 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d02ead4a-3526-4999-b19a-5572ed9ad5ec tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:21.097483 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d02ead4a-3526-4999-b19a-5572ed9ad5ec tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:21.098218 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d02ead4a-3526-4999-b19a-5572ed9ad5ec tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:21.098674 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d02ead4a-3526-4999-b19a-5572ed9ad5ec tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:21.099096 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-d02ead4a-3526-4999-b19a-5572ed9ad5ec tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:21.117587 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-d02ead4a-3526-4999-b19a-5572ed9ad5ec tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Getting quotas for project c742ff2fa942409384b6294cf883ce0a. Resources: {'ram', 'instances', 'cores'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:43:21.121602 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-d02ead4a-3526-4999-b19a-5572ed9ad5ec tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Getting quotas for user d32bf7e9512f4a51ae52a25bba18b891 and project c742ff2fa942409384b6294cf883ce0a. Resources: {'ram', 'instances', 'cores'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:43:21.182223 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d02ead4a-3526-4999-b19a-5572ed9ad5ec tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Going to run 1 instances... {{(pid=120708) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:43:21.184361 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-d02ead4a-3526-4999-b19a-5572ed9ad5ec tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: c490ec9d-3ee8-4751-b1b4-a2a802461fef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ccb02d81-9180-44e0-bb43-0e38e18c61aa',volume_size=None,volume_type=None)] {{(pid=120708) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:43:21.315090 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-d02ead4a-3526-4999-b19a-5572ed9ad5ec tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.820408 Aug 24 03:43:21.315718 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 477/964] 10.222.0.81 () {60 vars in 1147 bytes} [Wed Aug 24 03:43:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:43:21.327263 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-c9703fe3-c70e-42a7-a1e0-63a15dda09f4 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:21.327906 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-c9703fe3-c70e-42a7-a1e0-63a15dda09f4 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: c490ec9d-3ee8-4751-b1b4-a2a802461fef] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:21.331480 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell0:SELECT=4 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:21.332242 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:21.390664 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-c9703fe3-c70e-42a7-a1e0-63a15dda09f4 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:21.398160 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-c9703fe3-c70e-42a7-a1e0-63a15dda09f4 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef" status: 200 len: 1095 microversion: 2.1 time: 0.074806 Aug 24 03:43:21.398724 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 488/965] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:21 2022] GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:22.419739 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b8b6bdba-dae0-484d-8427-66d61ac6a21b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:22.420353 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-b8b6bdba-dae0-484d-8427-66d61ac6a21b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: c490ec9d-3ee8-4751-b1b4-a2a802461fef] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:22.427286 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b8b6bdba-dae0-484d-8427-66d61ac6a21b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:22.428284 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b8b6bdba-dae0-484d-8427-66d61ac6a21b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:22.428783 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b8b6bdba-dae0-484d-8427-66d61ac6a21b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:22.429579 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b8b6bdba-dae0-484d-8427-66d61ac6a21b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:22.430038 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b8b6bdba-dae0-484d-8427-66d61ac6a21b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:22.430464 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b8b6bdba-dae0-484d-8427-66d61ac6a21b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:22.495388 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-b8b6bdba-dae0-484d-8427-66d61ac6a21b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:22.504014 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-b8b6bdba-dae0-484d-8427-66d61ac6a21b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef" status: 200 len: 1211 microversion: 2.1 time: 0.088761 Aug 24 03:43:22.504793 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 478/966] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:22 2022] GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef => generated 1211 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:23.524901 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-fb6e3053-f8d8-4860-a13b-5927c189eacd tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:23.525522 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-fb6e3053-f8d8-4860-a13b-5927c189eacd tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: c490ec9d-3ee8-4751-b1b4-a2a802461fef] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:23.533519 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fb6e3053-f8d8-4860-a13b-5927c189eacd tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:23.534012 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fb6e3053-f8d8-4860-a13b-5927c189eacd tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:23.534497 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fb6e3053-f8d8-4860-a13b-5927c189eacd tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:23.535213 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fb6e3053-f8d8-4860-a13b-5927c189eacd tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:23.535672 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fb6e3053-f8d8-4860-a13b-5927c189eacd tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:23.536247 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-fb6e3053-f8d8-4860-a13b-5927c189eacd tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:23.675420 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-fb6e3053-f8d8-4860-a13b-5927c189eacd tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:23.683499 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-fb6e3053-f8d8-4860-a13b-5927c189eacd tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef" status: 200 len: 1266 microversion: 2.1 time: 0.162549 Aug 24 03:43:23.684061 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 489/967] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:23 2022] GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:23.996989 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-714cf737-4924-4bf5-b360-e8002db6f9e7 req-307ef98b-1d40-4c4e-a83f-3ef884a5d933 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c490ec9d-3ee8-4751-b1b4-a2a802461fef", "tag": "8df6ab2a-3dfb-47d0-adea-a25e707ba8ed"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:24.009055 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-714cf737-4924-4bf5-b360-e8002db6f9e7 req-307ef98b-1d40-4c4e-a83f-3ef884a5d933 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:24.009669 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-714cf737-4924-4bf5-b360-e8002db6f9e7 req-307ef98b-1d40-4c4e-a83f-3ef884a5d933 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:24.010169 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-714cf737-4924-4bf5-b360-e8002db6f9e7 req-307ef98b-1d40-4c4e-a83f-3ef884a5d933 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:24.023130 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-714cf737-4924-4bf5-b360-e8002db6f9e7 req-307ef98b-1d40-4c4e-a83f-3ef884a5d933 service nova] Creating event network-changed:8df6ab2a-3dfb-47d0-adea-a25e707ba8ed for instance c490ec9d-3ee8-4751-b1b4-a2a802461fef on hv-cinder-85426 Aug 24 03:43:24.028157 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-714cf737-4924-4bf5-b360-e8002db6f9e7 req-307ef98b-1d40-4c4e-a83f-3ef884a5d933 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035137 Aug 24 03:43:24.028749 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 479/968] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:43:24.704909 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-8c6efe76-9ae4-4abf-919b-a558ae18c2d3 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:24.705460 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-8c6efe76-9ae4-4abf-919b-a558ae18c2d3 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: c490ec9d-3ee8-4751-b1b4-a2a802461fef] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:24.712645 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8c6efe76-9ae4-4abf-919b-a558ae18c2d3 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:24.713157 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8c6efe76-9ae4-4abf-919b-a558ae18c2d3 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:24.713592 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8c6efe76-9ae4-4abf-919b-a558ae18c2d3 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:24.714280 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8c6efe76-9ae4-4abf-919b-a558ae18c2d3 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:24.714730 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8c6efe76-9ae4-4abf-919b-a558ae18c2d3 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:24.715150 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8c6efe76-9ae4-4abf-919b-a558ae18c2d3 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:24.851110 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-8c6efe76-9ae4-4abf-919b-a558ae18c2d3 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:24.858701 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-8c6efe76-9ae4-4abf-919b-a558ae18c2d3 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef" status: 200 len: 1266 microversion: 2.1 time: 0.157769 Aug 24 03:43:24.859265 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 490/969] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:24 2022] GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:25.880167 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7c4c07a6-fd7a-460b-b6d0-8b7bfd017f18 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:25.881514 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-7c4c07a6-fd7a-460b-b6d0-8b7bfd017f18 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: c490ec9d-3ee8-4751-b1b4-a2a802461fef] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:25.887635 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7c4c07a6-fd7a-460b-b6d0-8b7bfd017f18 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:25.888113 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7c4c07a6-fd7a-460b-b6d0-8b7bfd017f18 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:25.888544 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7c4c07a6-fd7a-460b-b6d0-8b7bfd017f18 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:25.889283 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7c4c07a6-fd7a-460b-b6d0-8b7bfd017f18 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:25.889733 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7c4c07a6-fd7a-460b-b6d0-8b7bfd017f18 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:25.890182 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7c4c07a6-fd7a-460b-b6d0-8b7bfd017f18 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:26.019979 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-7c4c07a6-fd7a-460b-b6d0-8b7bfd017f18 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:26.027823 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-7c4c07a6-fd7a-460b-b6d0-8b7bfd017f18 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef" status: 200 len: 1266 microversion: 2.1 time: 0.152316 Aug 24 03:43:26.028389 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 480/970] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:25 2022] GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:27.049030 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-0b98162b-c4a3-4925-acc3-10246bd6684e tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:27.049645 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-0b98162b-c4a3-4925-acc3-10246bd6684e tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: c490ec9d-3ee8-4751-b1b4-a2a802461fef] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:27.056114 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0b98162b-c4a3-4925-acc3-10246bd6684e tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:27.056632 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0b98162b-c4a3-4925-acc3-10246bd6684e tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:27.057102 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0b98162b-c4a3-4925-acc3-10246bd6684e tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:27.057794 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0b98162b-c4a3-4925-acc3-10246bd6684e tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:27.058250 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0b98162b-c4a3-4925-acc3-10246bd6684e tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:27.058675 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-0b98162b-c4a3-4925-acc3-10246bd6684e tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:27.191913 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-0b98162b-c4a3-4925-acc3-10246bd6684e tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:27.199999 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-0b98162b-c4a3-4925-acc3-10246bd6684e tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef" status: 200 len: 1266 microversion: 2.1 time: 0.154890 Aug 24 03:43:27.200551 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 491/971] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:27 2022] GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:28.221759 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ee32b0b5-a828-4823-92ad-39c8dd7566fe tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:28.222520 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ee32b0b5-a828-4823-92ad-39c8dd7566fe tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: c490ec9d-3ee8-4751-b1b4-a2a802461fef] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:28.232039 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ee32b0b5-a828-4823-92ad-39c8dd7566fe tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:28.232525 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ee32b0b5-a828-4823-92ad-39c8dd7566fe tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:28.232992 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ee32b0b5-a828-4823-92ad-39c8dd7566fe tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:28.233694 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ee32b0b5-a828-4823-92ad-39c8dd7566fe tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:28.234151 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ee32b0b5-a828-4823-92ad-39c8dd7566fe tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:28.234635 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ee32b0b5-a828-4823-92ad-39c8dd7566fe tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:28.372489 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ee32b0b5-a828-4823-92ad-39c8dd7566fe tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:28.380107 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ee32b0b5-a828-4823-92ad-39c8dd7566fe tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef" status: 200 len: 1266 microversion: 2.1 time: 0.162687 Aug 24 03:43:28.381859 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 481/972] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:28 2022] GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:29.403077 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-8bbdede5-9aab-482e-992a-47abc04c8501 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:29.403689 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-8bbdede5-9aab-482e-992a-47abc04c8501 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: c490ec9d-3ee8-4751-b1b4-a2a802461fef] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:29.409996 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8bbdede5-9aab-482e-992a-47abc04c8501 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:29.410487 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8bbdede5-9aab-482e-992a-47abc04c8501 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:29.410931 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8bbdede5-9aab-482e-992a-47abc04c8501 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:29.411699 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8bbdede5-9aab-482e-992a-47abc04c8501 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:29.412193 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8bbdede5-9aab-482e-992a-47abc04c8501 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:29.412635 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8bbdede5-9aab-482e-992a-47abc04c8501 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:29.544228 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-8bbdede5-9aab-482e-992a-47abc04c8501 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:29.551985 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-8bbdede5-9aab-482e-992a-47abc04c8501 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef" status: 200 len: 1266 microversion: 2.1 time: 0.152960 Aug 24 03:43:29.553145 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 492/973] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:29 2022] GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:30.575023 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b1853d2a-1d7a-4397-9b65-838cc94f2f15 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:30.575634 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-b1853d2a-1d7a-4397-9b65-838cc94f2f15 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: c490ec9d-3ee8-4751-b1b4-a2a802461fef] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:30.582292 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b1853d2a-1d7a-4397-9b65-838cc94f2f15 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:30.582788 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b1853d2a-1d7a-4397-9b65-838cc94f2f15 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:30.583229 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b1853d2a-1d7a-4397-9b65-838cc94f2f15 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:30.584586 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b1853d2a-1d7a-4397-9b65-838cc94f2f15 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:30.585077 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b1853d2a-1d7a-4397-9b65-838cc94f2f15 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:30.585508 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b1853d2a-1d7a-4397-9b65-838cc94f2f15 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:30.718554 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-b1853d2a-1d7a-4397-9b65-838cc94f2f15 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:30.726465 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-b1853d2a-1d7a-4397-9b65-838cc94f2f15 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef" status: 200 len: 1266 microversion: 2.1 time: 0.155319 Aug 24 03:43:30.726965 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 482/974] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:30 2022] GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:31.747208 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-07f1c0a3-0a3d-4549-bb7d-1bcef101089c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:31.747849 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-07f1c0a3-0a3d-4549-bb7d-1bcef101089c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: c490ec9d-3ee8-4751-b1b4-a2a802461fef] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:31.750282 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell0:SELECT=2 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:31.756789 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-07f1c0a3-0a3d-4549-bb7d-1bcef101089c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:31.757286 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-07f1c0a3-0a3d-4549-bb7d-1bcef101089c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:31.757723 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-07f1c0a3-0a3d-4549-bb7d-1bcef101089c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:31.758418 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-07f1c0a3-0a3d-4549-bb7d-1bcef101089c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:31.758885 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-07f1c0a3-0a3d-4549-bb7d-1bcef101089c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:31.759300 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-07f1c0a3-0a3d-4549-bb7d-1bcef101089c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:31.888218 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-07f1c0a3-0a3d-4549-bb7d-1bcef101089c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:31.896370 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-07f1c0a3-0a3d-4549-bb7d-1bcef101089c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef" status: 200 len: 1266 microversion: 2.1 time: 0.152505 Aug 24 03:43:31.896966 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 493/975] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:31 2022] GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:32.917851 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f6e15926-1f60-4605-adfd-5bef5c22c721 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:32.918469 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f6e15926-1f60-4605-adfd-5bef5c22c721 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: c490ec9d-3ee8-4751-b1b4-a2a802461fef] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:32.920416 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=2 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:32.921110 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=6 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:32.927902 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f6e15926-1f60-4605-adfd-5bef5c22c721 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:32.928954 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f6e15926-1f60-4605-adfd-5bef5c22c721 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:32.929408 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f6e15926-1f60-4605-adfd-5bef5c22c721 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:32.930110 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f6e15926-1f60-4605-adfd-5bef5c22c721 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:32.930569 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f6e15926-1f60-4605-adfd-5bef5c22c721 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:32.931001 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f6e15926-1f60-4605-adfd-5bef5c22c721 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:33.067010 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f6e15926-1f60-4605-adfd-5bef5c22c721 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:33.074842 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f6e15926-1f60-4605-adfd-5bef5c22c721 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef" status: 200 len: 1266 microversion: 2.1 time: 0.160903 Aug 24 03:43:33.075442 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 483/976] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:32 2022] GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:34.095559 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-1f5f320b-bb97-4df7-969c-a1ce320d4b4c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:34.096181 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-1f5f320b-bb97-4df7-969c-a1ce320d4b4c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: c490ec9d-3ee8-4751-b1b4-a2a802461fef] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:34.103784 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1f5f320b-bb97-4df7-969c-a1ce320d4b4c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:34.104276 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1f5f320b-bb97-4df7-969c-a1ce320d4b4c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:34.104720 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1f5f320b-bb97-4df7-969c-a1ce320d4b4c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:34.105444 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1f5f320b-bb97-4df7-969c-a1ce320d4b4c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:34.105908 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1f5f320b-bb97-4df7-969c-a1ce320d4b4c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:34.106339 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1f5f320b-bb97-4df7-969c-a1ce320d4b4c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:34.250352 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-1f5f320b-bb97-4df7-969c-a1ce320d4b4c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:34.258782 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-1f5f320b-bb97-4df7-969c-a1ce320d4b4c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef" status: 200 len: 1266 microversion: 2.1 time: 0.167090 Aug 24 03:43:34.259343 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 494/977] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:34 2022] GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:34.588807 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-9e67c51c-9fab-47bc-b587-703cc4912c5f req-fb807c5e-f6eb-43f9-b6f3-3b2fcb304eaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c490ec9d-3ee8-4751-b1b4-a2a802461fef", "name": "network-vif-plugged", "status": "completed", "tag": "8df6ab2a-3dfb-47d0-adea-a25e707ba8ed"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:34.598785 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-9e67c51c-9fab-47bc-b587-703cc4912c5f req-fb807c5e-f6eb-43f9-b6f3-3b2fcb304eaf service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:34.599466 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-9e67c51c-9fab-47bc-b587-703cc4912c5f req-fb807c5e-f6eb-43f9-b6f3-3b2fcb304eaf service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:34.599912 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-9e67c51c-9fab-47bc-b587-703cc4912c5f req-fb807c5e-f6eb-43f9-b6f3-3b2fcb304eaf service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:34.611254 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-9e67c51c-9fab-47bc-b587-703cc4912c5f req-fb807c5e-f6eb-43f9-b6f3-3b2fcb304eaf service nova] Creating event network-vif-plugged:8df6ab2a-3dfb-47d0-adea-a25e707ba8ed for instance c490ec9d-3ee8-4751-b1b4-a2a802461fef on hv-cinder-85426 Aug 24 03:43:34.616334 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-9e67c51c-9fab-47bc-b587-703cc4912c5f req-fb807c5e-f6eb-43f9-b6f3-3b2fcb304eaf service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112541 Aug 24 03:43:34.616968 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 484/978] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:43:35.279497 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-f4042436-ecad-435c-9f19-1e8752f3f00b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:35.280115 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-f4042436-ecad-435c-9f19-1e8752f3f00b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: c490ec9d-3ee8-4751-b1b4-a2a802461fef] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:35.287096 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f4042436-ecad-435c-9f19-1e8752f3f00b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:35.287624 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f4042436-ecad-435c-9f19-1e8752f3f00b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:35.288064 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f4042436-ecad-435c-9f19-1e8752f3f00b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:35.288758 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f4042436-ecad-435c-9f19-1e8752f3f00b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:35.289240 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f4042436-ecad-435c-9f19-1e8752f3f00b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:35.289671 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f4042436-ecad-435c-9f19-1e8752f3f00b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:35.419888 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-f4042436-ecad-435c-9f19-1e8752f3f00b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:35.428444 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-f4042436-ecad-435c-9f19-1e8752f3f00b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef" status: 200 len: 1266 microversion: 2.1 time: 0.152847 Aug 24 03:43:35.429113 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 495/979] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:35 2022] GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:36.355980 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:43:36.356679 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Wed Aug 24 03:43:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:43:36.450871 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-28632a59-466c-41e5-9330-f5992b23d54d tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:36.451497 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-28632a59-466c-41e5-9330-f5992b23d54d tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: c490ec9d-3ee8-4751-b1b4-a2a802461fef] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:36.457802 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-28632a59-466c-41e5-9330-f5992b23d54d tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:36.458325 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-28632a59-466c-41e5-9330-f5992b23d54d tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:36.458817 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-28632a59-466c-41e5-9330-f5992b23d54d tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:36.459600 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-28632a59-466c-41e5-9330-f5992b23d54d tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:36.460061 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-28632a59-466c-41e5-9330-f5992b23d54d tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:36.460492 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-28632a59-466c-41e5-9330-f5992b23d54d tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:36.590106 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-28632a59-466c-41e5-9330-f5992b23d54d tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:36.597845 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-28632a59-466c-41e5-9330-f5992b23d54d tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef" status: 200 len: 1452 microversion: 2.1 time: 0.151815 Aug 24 03:43:36.598410 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 485/980] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:36 2022] GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:36.618244 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-d6246648-9abc-4e05-b76b-ff4c92ae0b18 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:36.618865 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-d6246648-9abc-4e05-b76b-ff4c92ae0b18 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: c490ec9d-3ee8-4751-b1b4-a2a802461fef] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:36.625868 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d6246648-9abc-4e05-b76b-ff4c92ae0b18 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:36.626359 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d6246648-9abc-4e05-b76b-ff4c92ae0b18 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:36.626800 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d6246648-9abc-4e05-b76b-ff4c92ae0b18 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:36.627496 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d6246648-9abc-4e05-b76b-ff4c92ae0b18 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:36.627955 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d6246648-9abc-4e05-b76b-ff4c92ae0b18 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:36.628385 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-d6246648-9abc-4e05-b76b-ff4c92ae0b18 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:36.758116 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-d6246648-9abc-4e05-b76b-ff4c92ae0b18 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:36.765810 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-d6246648-9abc-4e05-b76b-ff4c92ae0b18 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef" status: 200 len: 1452 microversion: 2.1 time: 0.151728 Aug 24 03:43:36.766367 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 496/981] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:36 2022] GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:38.683616 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-b9e80749-d521-42a0-9cd5-ba9c9e73545f req-7a4bff07-7506-407d-bf6f-a7cfe27069fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c490ec9d-3ee8-4751-b1b4-a2a802461fef", "tag": "8df6ab2a-3dfb-47d0-adea-a25e707ba8ed"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:38.693845 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-b9e80749-d521-42a0-9cd5-ba9c9e73545f req-7a4bff07-7506-407d-bf6f-a7cfe27069fa service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:38.694320 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-b9e80749-d521-42a0-9cd5-ba9c9e73545f req-7a4bff07-7506-407d-bf6f-a7cfe27069fa service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:38.694755 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-b9e80749-d521-42a0-9cd5-ba9c9e73545f req-7a4bff07-7506-407d-bf6f-a7cfe27069fa service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:38.706074 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-b9e80749-d521-42a0-9cd5-ba9c9e73545f req-7a4bff07-7506-407d-bf6f-a7cfe27069fa service nova] Creating event network-changed:8df6ab2a-3dfb-47d0-adea-a25e707ba8ed for instance c490ec9d-3ee8-4751-b1b4-a2a802461fef on hv-cinder-85426 Aug 24 03:43:38.711006 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-b9e80749-d521-42a0-9cd5-ba9c9e73545f req-7a4bff07-7506-407d-bf6f-a7cfe27069fa service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088050 Aug 24 03:43:38.711603 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 486/982] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:32.748162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-15431f6f-eff5-4c1f-9619-3cf913fd5c95 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:32.748783 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-15431f6f-eff5-4c1f-9619-3cf913fd5c95 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: c490ec9d-3ee8-4751-b1b4-a2a802461fef] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:32.751232 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d184f7fb-4775-4b6c-9cd9-27e1490fe984] AMQP server on 10.222.0.81:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 03:45:32.751776 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_api:SELECT=20 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:32.752617 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell1:SELECT=48 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:32.758730 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-15431f6f-eff5-4c1f-9619-3cf913fd5c95 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:32.759224 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-15431f6f-eff5-4c1f-9619-3cf913fd5c95 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:32.759661 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-15431f6f-eff5-4c1f-9619-3cf913fd5c95 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:32.760548 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-15431f6f-eff5-4c1f-9619-3cf913fd5c95 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:32.761041 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-15431f6f-eff5-4c1f-9619-3cf913fd5c95 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:32.761470 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-15431f6f-eff5-4c1f-9619-3cf913fd5c95 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:32.786964 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-15431f6f-eff5-4c1f-9619-3cf913fd5c95 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: c490ec9d-3ee8-4751-b1b4-a2a802461fef] Going to try to terminate instance {{(pid=120709) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:45:32.866905 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-15431f6f-eff5-4c1f-9619-3cf913fd5c95 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "DELETE /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef" status: 204 len: 0 microversion: 2.1 time: 0.123078 Aug 24 03:45:32.868178 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 497/983] 10.222.0.81 () {58 vars in 1239 bytes} [Wed Aug 24 03:45:32 2022] DELETE /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:45:32.874796 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:32.875576 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=44 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:32.880119 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-59abcde1-11c2-4057-9ab4-1f02b1fe3316 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:32.880854 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-59abcde1-11c2-4057-9ab4-1f02b1fe3316 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: c490ec9d-3ee8-4751-b1b4-a2a802461fef] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:32.892027 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-59abcde1-11c2-4057-9ab4-1f02b1fe3316 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:32.893738 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-59abcde1-11c2-4057-9ab4-1f02b1fe3316 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:32.894197 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-59abcde1-11c2-4057-9ab4-1f02b1fe3316 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:32.894935 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-59abcde1-11c2-4057-9ab4-1f02b1fe3316 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:32.895408 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-59abcde1-11c2-4057-9ab4-1f02b1fe3316 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:32.895842 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-59abcde1-11c2-4057-9ab4-1f02b1fe3316 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:33.090097 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-59abcde1-11c2-4057-9ab4-1f02b1fe3316 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:33.097812 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-59abcde1-11c2-4057-9ab4-1f02b1fe3316 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef" status: 200 len: 1577 microversion: 2.1 time: 0.225209 Aug 24 03:45:33.098369 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 487/984] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:32 2022] GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef => generated 1577 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:34.121200 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-7f52515d-2c7c-44d0-8d16-5ca3c02c9403 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:34.121907 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-7f52515d-2c7c-44d0-8d16-5ca3c02c9403 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: c490ec9d-3ee8-4751-b1b4-a2a802461fef] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:34.129601 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7f52515d-2c7c-44d0-8d16-5ca3c02c9403 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:34.130085 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7f52515d-2c7c-44d0-8d16-5ca3c02c9403 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:34.130520 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7f52515d-2c7c-44d0-8d16-5ca3c02c9403 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:34.131213 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7f52515d-2c7c-44d0-8d16-5ca3c02c9403 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:34.131669 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7f52515d-2c7c-44d0-8d16-5ca3c02c9403 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:34.132093 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7f52515d-2c7c-44d0-8d16-5ca3c02c9403 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:34.138634 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO oslo.messaging._drivers.impl_rabbit [-] [d184f7fb-4775-4b6c-9cd9-27e1490fe984] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 39074. Aug 24 03:45:34.314771 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-7f52515d-2c7c-44d0-8d16-5ca3c02c9403 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:34.322453 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-7f52515d-2c7c-44d0-8d16-5ca3c02c9403 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef" status: 200 len: 1577 microversion: 2.1 time: 0.206666 Aug 24 03:45:34.323106 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 498/985] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:34 2022] GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef => generated 1577 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:35.343885 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-aafdcda7-7119-4811-acb8-16a2a1275083 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:35.344512 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-aafdcda7-7119-4811-acb8-16a2a1275083 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: c490ec9d-3ee8-4751-b1b4-a2a802461fef] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:35.350405 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-aafdcda7-7119-4811-acb8-16a2a1275083 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:35.350894 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-aafdcda7-7119-4811-acb8-16a2a1275083 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:35.351335 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-aafdcda7-7119-4811-acb8-16a2a1275083 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:35.352039 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-aafdcda7-7119-4811-acb8-16a2a1275083 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:35.352499 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-aafdcda7-7119-4811-acb8-16a2a1275083 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:35.352954 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-aafdcda7-7119-4811-acb8-16a2a1275083 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:35.424177 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-aafdcda7-7119-4811-acb8-16a2a1275083 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:35.424449 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-d1c97aa1-b897-4de9-8d6f-e7319e1f9670 req-69a83a03-cda7-4470-9e96-236ec1e21331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c490ec9d-3ee8-4751-b1b4-a2a802461fef", "name": "network-vif-deleted", "tag": "8df6ab2a-3dfb-47d0-adea-a25e707ba8ed"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:35.434205 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-aafdcda7-7119-4811-acb8-16a2a1275083 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef" status: 200 len: 1510 microversion: 2.1 time: 0.094332 Aug 24 03:45:35.435027 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 488/986] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:35 2022] GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef => generated 1510 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:35.437577 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-d1c97aa1-b897-4de9-8d6f-e7319e1f9670 req-69a83a03-cda7-4470-9e96-236ec1e21331 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:35.438061 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-d1c97aa1-b897-4de9-8d6f-e7319e1f9670 req-69a83a03-cda7-4470-9e96-236ec1e21331 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:35.439389 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-d1c97aa1-b897-4de9-8d6f-e7319e1f9670 req-69a83a03-cda7-4470-9e96-236ec1e21331 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:35.452696 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-d1c97aa1-b897-4de9-8d6f-e7319e1f9670 req-69a83a03-cda7-4470-9e96-236ec1e21331 service nova] Creating event network-vif-deleted:8df6ab2a-3dfb-47d0-adea-a25e707ba8ed for instance c490ec9d-3ee8-4751-b1b4-a2a802461fef on hv-cinder-85426 Aug 24 03:45:35.465161 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-d1c97aa1-b897-4de9-8d6f-e7319e1f9670 req-69a83a03-cda7-4470-9e96-236ec1e21331 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042038 Aug 24 03:45:35.466712 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 499/987] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:36.456699 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-70a6df65-fb04-416e-93ea-90b9207105ef tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:36.457284 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-70a6df65-fb04-416e-93ea-90b9207105ef tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: c490ec9d-3ee8-4751-b1b4-a2a802461fef] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:36.464430 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-70a6df65-fb04-416e-93ea-90b9207105ef tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:36.464950 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-70a6df65-fb04-416e-93ea-90b9207105ef tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:36.465392 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-70a6df65-fb04-416e-93ea-90b9207105ef tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:36.466092 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-70a6df65-fb04-416e-93ea-90b9207105ef tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:36.466556 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-70a6df65-fb04-416e-93ea-90b9207105ef tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:36.467007 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-70a6df65-fb04-416e-93ea-90b9207105ef tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:36.483980 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-70a6df65-fb04-416e-93ea-90b9207105ef tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] HTTP exception thrown: Instance c490ec9d-3ee8-4751-b1b4-a2a802461fef could not be found. Aug 24 03:45:36.485648 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-70a6df65-fb04-416e-93ea-90b9207105ef tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Request method failure captured: Aug 24 03:45:36.485648 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef HTTP/1.1 Aug 24 03:45:36.485648 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 24 03:45:36.485648 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 24 03:45:36.485648 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Connection: close Aug 24 03:45:36.485648 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 24 03:45:36.485648 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 24 03:45:36.485648 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Host: 10.222.0.81 Aug 24 03:45:36.485648 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 24 03:45:36.485648 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.11 Aug 24 03:45:36.485648 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjBZ5C5Nyg8blEXeQ_OHyi5xfYVpO3ig_gkwsF4RFVgwvEzGzV-XFbKVcFKZeFMHVff9N1OWdpi9vsFospfdzuJ83C1kje2npifOEb7U4FJi_x5Md2OccxsavbDIUuhhH78RjOLkk374i-zeJXK5adKH0abQLWM6i6GnUazmWWqKDZqpY Aug 24 03:45:36.485648 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 24 03:45:36.485648 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 24 03:45:36.485648 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 24 03:45:36.485648 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 24 03:45:36.485648 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 24 03:45:36.485648 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 24 03:45:36.485648 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Id: c742ff2fa942409384b6294cf883ce0a Aug 24 03:45:36.485648 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-TestVolumeBootPattern-212920611 Aug 24 03:45:36.485648 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 24 03:45:36.485648 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 24 03:45:36.487270 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c742ff2fa942409384b6294cf883ce0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_c742ff2fa942409384b6294cf883ce0a", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c742ff2fa942409384b6294cf883ce0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/c742ff2fa942409384b6294cf883ce0a"}]}] Aug 24 03:45:36.487270 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-TestVolumeBootPattern-212920611 Aug 24 03:45:36.487270 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Id: c742ff2fa942409384b6294cf883ce0a Aug 24 03:45:36.487270 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-TestVolumeBootPattern-212920611 Aug 24 03:45:36.487270 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User: tempest-TestVolumeBootPattern-212920611-project Aug 24 03:45:36.487270 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 24 03:45:36.487270 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 24 03:45:36.487270 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Id: d32bf7e9512f4a51ae52a25bba18b891 Aug 24 03:45:36.487270 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-TestVolumeBootPattern-212920611-project Aug 24 03:45:36.487270 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: method: > Aug 24 03:45:36.487270 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: exception: Instance c490ec9d-3ee8-4751-b1b4-a2a802461fef could not be found. Aug 24 03:45:36.487270 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: action_args: {'id': 'c490ec9d-3ee8-4751-b1b4-a2a802461fef'} Aug 24 03:45:36.488438 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:45:36.488438 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:36.488438 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:45:36.488438 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:45:36.488438 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:45:36.488438 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:45:36.488438 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:45:36.488438 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:45:36.488438 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:45:36.488438 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:45:36.488438 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c490ec9d-3ee8-4751-b1b4-a2a802461fef could not be found. Aug 24 03:45:36.488438 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:45:36.488438 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:45:36.488438 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:45:36.488438 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:36.488438 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:45:36.488438 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:45:36.488438 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:45:36.488438 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:45:36.488438 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:45:36.490008 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:45:36.490008 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:45:36.490008 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:45:36.490008 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:45:36.490008 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:45:36.490008 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:45:36.490008 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:45:36.490008 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c490ec9d-3ee8-4751-b1b4-a2a802461fef could not be found. Aug 24 03:45:36.490008 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:45:36.490008 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:45:36.490008 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:45:36.490008 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:45:36.490008 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:45:36.490008 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:45:36.490008 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:45:36.490008 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:45:36.490008 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c490ec9d-3ee8-4751-b1b4-a2a802461fef could not be found. Aug 24 03:45:36.490008 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:45:36.491399 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-70a6df65-fb04-416e-93ea-90b9207105ef tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Returning 404 to user: Instance c490ec9d-3ee8-4751-b1b4-a2a802461fef could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:45:36.491399 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-70a6df65-fb04-416e-93ea-90b9207105ef tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef" status: 404 len: 111 microversion: 2.1 time: 0.034376 Aug 24 03:45:36.491399 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 489/988] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:36 2022] GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:45:36.538160 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-186c4f8f-f46c-418c-8143-89b7cce3ac49 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1686028904", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1735211970", "security_groups": [{"name": "tempest-secgroup-smoke-573258359"}], "block_device_mapping_v2": [{"uuid": "ccb02d81-9180-44e0-bb43-0e38e18c61aa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a77328d1-9351-48c2-a2f3-0639347291ff"}]}} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:36.650383 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.network.neutron [None req-186c4f8f-f46c-418c-8143-89b7cce3ac49 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] validate_networks() for [('a77328d1-9351-48c2-a2f3-0639347291ff', None, None, None, None, None)] {{(pid=120709) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:45:37.064234 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-186c4f8f-f46c-418c-8143-89b7cce3ac49 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Flavor limits 0:0:0 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:45:37.064672 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-186c4f8f-f46c-418c-8143-89b7cce3ac49 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Image limits 0:0:0 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:45:37.065163 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-186c4f8f-f46c-418c-8143-89b7cce3ac49 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Flavor pref 0:0:0 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:45:37.065574 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-186c4f8f-f46c-418c-8143-89b7cce3ac49 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Image pref 0:0:0 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:45:37.065987 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.virt.hardware [None req-186c4f8f-f46c-418c-8143-89b7cce3ac49 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120709) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:45:37.075257 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-186c4f8f-f46c-418c-8143-89b7cce3ac49 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:37.075746 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-186c4f8f-f46c-418c-8143-89b7cce3ac49 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:37.076181 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-186c4f8f-f46c-418c-8143-89b7cce3ac49 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:37.076950 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-186c4f8f-f46c-418c-8143-89b7cce3ac49 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:37.077411 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-186c4f8f-f46c-418c-8143-89b7cce3ac49 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:37.077870 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-186c4f8f-f46c-418c-8143-89b7cce3ac49 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:37.095454 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.quota [None req-186c4f8f-f46c-418c-8143-89b7cce3ac49 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Getting quotas for project c742ff2fa942409384b6294cf883ce0a. Resources: {'ram', 'instances', 'cores'} {{(pid=120709) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:45:37.099313 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.quota [None req-186c4f8f-f46c-418c-8143-89b7cce3ac49 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Getting quotas for user d32bf7e9512f4a51ae52a25bba18b891 and project c742ff2fa942409384b6294cf883ce0a. Resources: {'ram', 'instances', 'cores'} {{(pid=120709) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:45:37.155905 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-186c4f8f-f46c-418c-8143-89b7cce3ac49 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Going to run 1 instances... {{(pid=120709) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:45:37.158155 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-186c4f8f-f46c-418c-8143-89b7cce3ac49 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 98a71e9c-31b1-4efe-9580-1aeb161cb712] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ccb02d81-9180-44e0-bb43-0e38e18c61aa',volume_size=None,volume_type=None)] {{(pid=120709) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:45:37.297027 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-186c4f8f-f46c-418c-8143-89b7cce3ac49 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.763586 Aug 24 03:45:37.297682 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 500/989] 10.222.0.81 () {60 vars in 1147 bytes} [Wed Aug 24 03:45:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:45:37.318124 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a6477833-761a-480c-bd24-1b68ddd95960 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:37.318742 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a6477833-761a-480c-bd24-1b68ddd95960 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 98a71e9c-31b1-4efe-9580-1aeb161cb712] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:37.377908 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a6477833-761a-480c-bd24-1b68ddd95960 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:37.384922 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a6477833-761a-480c-bd24-1b68ddd95960 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712" status: 200 len: 1095 microversion: 2.1 time: 0.071229 Aug 24 03:45:37.386075 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 490/990] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:37 2022] GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712 => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:38.406341 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-01ef9947-967b-4a9a-b3eb-6f1ee77e7cf2 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:38.407197 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-01ef9947-967b-4a9a-b3eb-6f1ee77e7cf2 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 98a71e9c-31b1-4efe-9580-1aeb161cb712] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:38.413969 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-01ef9947-967b-4a9a-b3eb-6f1ee77e7cf2 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:38.414661 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-01ef9947-967b-4a9a-b3eb-6f1ee77e7cf2 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:38.415041 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-01ef9947-967b-4a9a-b3eb-6f1ee77e7cf2 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:38.415821 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-01ef9947-967b-4a9a-b3eb-6f1ee77e7cf2 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:38.416381 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-01ef9947-967b-4a9a-b3eb-6f1ee77e7cf2 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:38.416906 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-01ef9947-967b-4a9a-b3eb-6f1ee77e7cf2 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:38.480333 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-01ef9947-967b-4a9a-b3eb-6f1ee77e7cf2 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:38.488662 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-01ef9947-967b-4a9a-b3eb-6f1ee77e7cf2 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712" status: 200 len: 1211 microversion: 2.1 time: 0.086269 Aug 24 03:45:38.489447 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 501/991] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:38 2022] GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712 => generated 1211 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:39.510527 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-e98ce293-2c68-4197-956d-6cf351896db7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:39.511388 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-e98ce293-2c68-4197-956d-6cf351896db7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 98a71e9c-31b1-4efe-9580-1aeb161cb712] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:39.518735 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e98ce293-2c68-4197-956d-6cf351896db7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:39.519228 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e98ce293-2c68-4197-956d-6cf351896db7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:39.519671 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e98ce293-2c68-4197-956d-6cf351896db7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:39.520376 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e98ce293-2c68-4197-956d-6cf351896db7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:39.520860 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e98ce293-2c68-4197-956d-6cf351896db7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:39.521296 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e98ce293-2c68-4197-956d-6cf351896db7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:39.645812 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-3eb3f22e-d5f5-4610-af6c-d3106d5479ba req-92d6e9b4-5955-4c46-926a-cbc3d1b3133c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98a71e9c-31b1-4efe-9580-1aeb161cb712", "tag": "94e62715-a19a-4e2c-9d13-d5ced48f4941"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:39.656794 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-e98ce293-2c68-4197-956d-6cf351896db7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:39.658256 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-3eb3f22e-d5f5-4610-af6c-d3106d5479ba req-92d6e9b4-5955-4c46-926a-cbc3d1b3133c service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:39.658743 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-3eb3f22e-d5f5-4610-af6c-d3106d5479ba req-92d6e9b4-5955-4c46-926a-cbc3d1b3133c service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:39.659177 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-3eb3f22e-d5f5-4610-af6c-d3106d5479ba req-92d6e9b4-5955-4c46-926a-cbc3d1b3133c service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:39.670348 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-3eb3f22e-d5f5-4610-af6c-d3106d5479ba req-92d6e9b4-5955-4c46-926a-cbc3d1b3133c service nova] Creating event network-changed:94e62715-a19a-4e2c-9d13-d5ced48f4941 for instance 98a71e9c-31b1-4efe-9580-1aeb161cb712 on hv-cinder-85426 Aug 24 03:45:39.674395 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-e98ce293-2c68-4197-956d-6cf351896db7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712" status: 200 len: 1266 microversion: 2.1 time: 0.167118 Aug 24 03:45:39.676838 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-3eb3f22e-d5f5-4610-af6c-d3106d5479ba req-92d6e9b4-5955-4c46-926a-cbc3d1b3133c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033408 Aug 24 03:45:39.677013 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 491/992] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:39 2022] GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:39.677125 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 502/993] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:45:40.695556 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-eb25d2f8-ae2f-4e17-a38b-5d123effc5e5 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:40.696188 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-eb25d2f8-ae2f-4e17-a38b-5d123effc5e5 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 98a71e9c-31b1-4efe-9580-1aeb161cb712] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:40.703189 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eb25d2f8-ae2f-4e17-a38b-5d123effc5e5 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:40.703680 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eb25d2f8-ae2f-4e17-a38b-5d123effc5e5 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:40.704126 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eb25d2f8-ae2f-4e17-a38b-5d123effc5e5 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:40.704856 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eb25d2f8-ae2f-4e17-a38b-5d123effc5e5 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:40.705324 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eb25d2f8-ae2f-4e17-a38b-5d123effc5e5 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:40.705756 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-eb25d2f8-ae2f-4e17-a38b-5d123effc5e5 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:40.842282 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-eb25d2f8-ae2f-4e17-a38b-5d123effc5e5 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:40.850065 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-eb25d2f8-ae2f-4e17-a38b-5d123effc5e5 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712" status: 200 len: 1266 microversion: 2.1 time: 0.158352 Aug 24 03:45:40.850626 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 492/994] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:40 2022] GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:41.871151 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-e2ea623b-6c09-409e-9b14-3693c0671bc0 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:41.871849 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-e2ea623b-6c09-409e-9b14-3693c0671bc0 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 98a71e9c-31b1-4efe-9580-1aeb161cb712] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:41.877986 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e2ea623b-6c09-409e-9b14-3693c0671bc0 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:41.878470 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e2ea623b-6c09-409e-9b14-3693c0671bc0 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:41.878910 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e2ea623b-6c09-409e-9b14-3693c0671bc0 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:41.879600 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e2ea623b-6c09-409e-9b14-3693c0671bc0 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:41.880055 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e2ea623b-6c09-409e-9b14-3693c0671bc0 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:41.880481 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e2ea623b-6c09-409e-9b14-3693c0671bc0 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:42.015600 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-e2ea623b-6c09-409e-9b14-3693c0671bc0 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:42.023193 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-e2ea623b-6c09-409e-9b14-3693c0671bc0 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712" status: 200 len: 1266 microversion: 2.1 time: 0.156705 Aug 24 03:45:42.023753 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 503/995] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:41 2022] GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:43.046950 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-a95b28ec-345b-4572-8e8c-01ff9df9dad7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:43.047613 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-a95b28ec-345b-4572-8e8c-01ff9df9dad7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 98a71e9c-31b1-4efe-9580-1aeb161cb712] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:43.054210 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a95b28ec-345b-4572-8e8c-01ff9df9dad7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:43.054692 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a95b28ec-345b-4572-8e8c-01ff9df9dad7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:43.055126 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a95b28ec-345b-4572-8e8c-01ff9df9dad7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:43.055812 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a95b28ec-345b-4572-8e8c-01ff9df9dad7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:43.056268 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a95b28ec-345b-4572-8e8c-01ff9df9dad7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:43.057431 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-a95b28ec-345b-4572-8e8c-01ff9df9dad7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:43.185976 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-a95b28ec-345b-4572-8e8c-01ff9df9dad7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:43.193738 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-a95b28ec-345b-4572-8e8c-01ff9df9dad7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712" status: 200 len: 1266 microversion: 2.1 time: 0.153405 Aug 24 03:45:43.194297 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 493/996] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:43 2022] GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:44.215059 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-2ba656b8-0de0-4df2-9441-893cc17c22a3 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:44.215607 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-2ba656b8-0de0-4df2-9441-893cc17c22a3 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 98a71e9c-31b1-4efe-9580-1aeb161cb712] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:44.222123 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2ba656b8-0de0-4df2-9441-893cc17c22a3 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:44.222634 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2ba656b8-0de0-4df2-9441-893cc17c22a3 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:44.223068 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2ba656b8-0de0-4df2-9441-893cc17c22a3 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:44.223752 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2ba656b8-0de0-4df2-9441-893cc17c22a3 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:44.224214 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2ba656b8-0de0-4df2-9441-893cc17c22a3 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:44.224635 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2ba656b8-0de0-4df2-9441-893cc17c22a3 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:44.357777 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-2ba656b8-0de0-4df2-9441-893cc17c22a3 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:44.365417 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-2ba656b8-0de0-4df2-9441-893cc17c22a3 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712" status: 200 len: 1266 microversion: 2.1 time: 0.155039 Aug 24 03:45:44.365971 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 504/997] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:44 2022] GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:45.387053 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-94d4e69a-7eb0-4c19-b512-48222368e8f5 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:45.387688 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-94d4e69a-7eb0-4c19-b512-48222368e8f5 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 98a71e9c-31b1-4efe-9580-1aeb161cb712] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:45.394089 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-94d4e69a-7eb0-4c19-b512-48222368e8f5 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:45.394563 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-94d4e69a-7eb0-4c19-b512-48222368e8f5 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:45.394992 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-94d4e69a-7eb0-4c19-b512-48222368e8f5 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:45.395672 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-94d4e69a-7eb0-4c19-b512-48222368e8f5 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:45.396121 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-94d4e69a-7eb0-4c19-b512-48222368e8f5 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:45.396539 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-94d4e69a-7eb0-4c19-b512-48222368e8f5 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:45.523848 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-94d4e69a-7eb0-4c19-b512-48222368e8f5 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:45.531830 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-94d4e69a-7eb0-4c19-b512-48222368e8f5 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712" status: 200 len: 1266 microversion: 2.1 time: 0.149293 Aug 24 03:45:45.532389 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 494/998] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:45 2022] GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:46.552512 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-ea1f0572-89a4-416e-93e1-568c9b218590 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:46.553168 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-ea1f0572-89a4-416e-93e1-568c9b218590 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 98a71e9c-31b1-4efe-9580-1aeb161cb712] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:46.559823 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ea1f0572-89a4-416e-93e1-568c9b218590 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:46.560307 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ea1f0572-89a4-416e-93e1-568c9b218590 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:46.560745 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ea1f0572-89a4-416e-93e1-568c9b218590 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:46.561465 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ea1f0572-89a4-416e-93e1-568c9b218590 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:46.561939 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ea1f0572-89a4-416e-93e1-568c9b218590 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:46.562348 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-ea1f0572-89a4-416e-93e1-568c9b218590 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:46.694996 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-ea1f0572-89a4-416e-93e1-568c9b218590 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:46.703176 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-ea1f0572-89a4-416e-93e1-568c9b218590 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712" status: 200 len: 1266 microversion: 2.1 time: 0.154532 Aug 24 03:45:46.703736 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 505/999] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:46 2022] GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:47.725269 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-4d21a948-44ce-465d-a732-f441e5aa9fbb tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:47.725791 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-4d21a948-44ce-465d-a732-f441e5aa9fbb tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 98a71e9c-31b1-4efe-9580-1aeb161cb712] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:47.728084 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=2 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:47.733340 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4d21a948-44ce-465d-a732-f441e5aa9fbb tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:47.733821 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4d21a948-44ce-465d-a732-f441e5aa9fbb tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:47.734255 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4d21a948-44ce-465d-a732-f441e5aa9fbb tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:47.734945 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4d21a948-44ce-465d-a732-f441e5aa9fbb tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:47.735396 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4d21a948-44ce-465d-a732-f441e5aa9fbb tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:47.735816 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-4d21a948-44ce-465d-a732-f441e5aa9fbb tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:47.868162 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-4d21a948-44ce-465d-a732-f441e5aa9fbb tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:47.876398 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-4d21a948-44ce-465d-a732-f441e5aa9fbb tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712" status: 200 len: 1266 microversion: 2.1 time: 0.155094 Aug 24 03:45:47.876996 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 495/1000] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:47 2022] GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:48.896273 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-bbdab936-8c53-4c49-9bd9-4c3e87886447 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:48.896925 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-bbdab936-8c53-4c49-9bd9-4c3e87886447 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 98a71e9c-31b1-4efe-9580-1aeb161cb712] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:48.898932 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell0:SELECT=2 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:48.899552 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell0:SELECT=6 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:48.906462 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bbdab936-8c53-4c49-9bd9-4c3e87886447 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:48.906958 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bbdab936-8c53-4c49-9bd9-4c3e87886447 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:48.907402 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bbdab936-8c53-4c49-9bd9-4c3e87886447 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:48.908117 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bbdab936-8c53-4c49-9bd9-4c3e87886447 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:48.908575 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bbdab936-8c53-4c49-9bd9-4c3e87886447 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:48.909039 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-bbdab936-8c53-4c49-9bd9-4c3e87886447 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:49.046329 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-bbdab936-8c53-4c49-9bd9-4c3e87886447 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:49.055176 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-bbdab936-8c53-4c49-9bd9-4c3e87886447 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712" status: 200 len: 1266 microversion: 2.1 time: 0.162753 Aug 24 03:45:49.055826 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 506/1001] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:48 2022] GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:50.077535 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-e5c0933a-2f69-4022-ba13-ceda40a04da7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:50.078505 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-e5c0933a-2f69-4022-ba13-ceda40a04da7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 98a71e9c-31b1-4efe-9580-1aeb161cb712] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:50.087008 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e5c0933a-2f69-4022-ba13-ceda40a04da7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:50.087503 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e5c0933a-2f69-4022-ba13-ceda40a04da7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:50.087949 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e5c0933a-2f69-4022-ba13-ceda40a04da7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:50.089186 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e5c0933a-2f69-4022-ba13-ceda40a04da7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:50.089646 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e5c0933a-2f69-4022-ba13-ceda40a04da7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:50.090078 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e5c0933a-2f69-4022-ba13-ceda40a04da7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:50.221974 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-e5c0933a-2f69-4022-ba13-ceda40a04da7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:50.230205 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-e5c0933a-2f69-4022-ba13-ceda40a04da7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712" status: 200 len: 1266 microversion: 2.1 time: 0.157559 Aug 24 03:45:50.230760 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 496/1002] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:50 2022] GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:51.131259 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-0112a99e-0fa3-4f2f-b0a4-55e6ca1517b1 req-67dd785f-cbc3-4f62-bede-94755751d8e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98a71e9c-31b1-4efe-9580-1aeb161cb712", "name": "network-vif-plugged", "status": "completed", "tag": "94e62715-a19a-4e2c-9d13-d5ced48f4941"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:51.143496 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-0112a99e-0fa3-4f2f-b0a4-55e6ca1517b1 req-67dd785f-cbc3-4f62-bede-94755751d8e3 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:51.144157 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-0112a99e-0fa3-4f2f-b0a4-55e6ca1517b1 req-67dd785f-cbc3-4f62-bede-94755751d8e3 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:51.144589 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-0112a99e-0fa3-4f2f-b0a4-55e6ca1517b1 req-67dd785f-cbc3-4f62-bede-94755751d8e3 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:51.157664 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-0112a99e-0fa3-4f2f-b0a4-55e6ca1517b1 req-67dd785f-cbc3-4f62-bede-94755751d8e3 service nova] Creating event network-vif-plugged:94e62715-a19a-4e2c-9d13-d5ced48f4941 for instance 98a71e9c-31b1-4efe-9580-1aeb161cb712 on hv-cinder-85426 Aug 24 03:45:51.162706 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-0112a99e-0fa3-4f2f-b0a4-55e6ca1517b1 req-67dd785f-cbc3-4f62-bede-94755751d8e3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035072 Aug 24 03:45:51.163427 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 507/1003] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:51.250775 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1d29cd88-827d-4f4d-9a40-e68805ff80c9 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:51.251385 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1d29cd88-827d-4f4d-9a40-e68805ff80c9 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 98a71e9c-31b1-4efe-9580-1aeb161cb712] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:51.257769 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1d29cd88-827d-4f4d-9a40-e68805ff80c9 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:51.258250 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1d29cd88-827d-4f4d-9a40-e68805ff80c9 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:51.258706 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1d29cd88-827d-4f4d-9a40-e68805ff80c9 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:51.259374 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1d29cd88-827d-4f4d-9a40-e68805ff80c9 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:51.259827 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1d29cd88-827d-4f4d-9a40-e68805ff80c9 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:51.261145 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1d29cd88-827d-4f4d-9a40-e68805ff80c9 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:51.398767 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1d29cd88-827d-4f4d-9a40-e68805ff80c9 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:51.406989 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1d29cd88-827d-4f4d-9a40-e68805ff80c9 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712" status: 200 len: 1266 microversion: 2.1 time: 0.160020 Aug 24 03:45:51.407594 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 497/1004] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:51 2022] GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:52.428025 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-7125bdc7-3a42-42b6-be5b-98c434986e81 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:52.428807 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-7125bdc7-3a42-42b6-be5b-98c434986e81 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 98a71e9c-31b1-4efe-9580-1aeb161cb712] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:52.435952 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7125bdc7-3a42-42b6-be5b-98c434986e81 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:52.436443 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7125bdc7-3a42-42b6-be5b-98c434986e81 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:52.436911 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7125bdc7-3a42-42b6-be5b-98c434986e81 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:52.437617 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7125bdc7-3a42-42b6-be5b-98c434986e81 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:52.438074 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7125bdc7-3a42-42b6-be5b-98c434986e81 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:52.438504 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-7125bdc7-3a42-42b6-be5b-98c434986e81 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:52.576812 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-7125bdc7-3a42-42b6-be5b-98c434986e81 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:52.584417 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-7125bdc7-3a42-42b6-be5b-98c434986e81 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712" status: 200 len: 1453 microversion: 2.1 time: 0.160626 Aug 24 03:45:52.586397 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 508/1005] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:52 2022] GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712 => generated 1453 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:52.607398 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-724ec1c3-5169-4add-8ee0-038a6f59863c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:52.608011 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-724ec1c3-5169-4add-8ee0-038a6f59863c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 98a71e9c-31b1-4efe-9580-1aeb161cb712] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:52.614661 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-724ec1c3-5169-4add-8ee0-038a6f59863c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:52.615146 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-724ec1c3-5169-4add-8ee0-038a6f59863c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:52.615586 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-724ec1c3-5169-4add-8ee0-038a6f59863c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:52.616277 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-724ec1c3-5169-4add-8ee0-038a6f59863c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:52.616733 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-724ec1c3-5169-4add-8ee0-038a6f59863c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:52.617184 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-724ec1c3-5169-4add-8ee0-038a6f59863c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:52.750170 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-724ec1c3-5169-4add-8ee0-038a6f59863c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:45:52.759504 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-724ec1c3-5169-4add-8ee0-038a6f59863c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712" status: 200 len: 1453 microversion: 2.1 time: 0.156515 Aug 24 03:45:52.760675 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 498/1006] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:45:52 2022] GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:54.577079 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-83139dc8-e021-41fb-9c9e-67de13ed42f6 req-c563f274-e0db-4bea-96ce-6c130b4c5d5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98a71e9c-31b1-4efe-9580-1aeb161cb712", "tag": "94e62715-a19a-4e2c-9d13-d5ced48f4941"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:54.587107 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-83139dc8-e021-41fb-9c9e-67de13ed42f6 req-c563f274-e0db-4bea-96ce-6c130b4c5d5c service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:54.587722 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-83139dc8-e021-41fb-9c9e-67de13ed42f6 req-c563f274-e0db-4bea-96ce-6c130b4c5d5c service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:54.588818 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-83139dc8-e021-41fb-9c9e-67de13ed42f6 req-c563f274-e0db-4bea-96ce-6c130b4c5d5c service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:54.599717 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-83139dc8-e021-41fb-9c9e-67de13ed42f6 req-c563f274-e0db-4bea-96ce-6c130b4c5d5c service nova] Creating event network-changed:94e62715-a19a-4e2c-9d13-d5ced48f4941 for instance 98a71e9c-31b1-4efe-9580-1aeb161cb712 on hv-cinder-85426 Aug 24 03:45:54.605432 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-83139dc8-e021-41fb-9c9e-67de13ed42f6 req-c563f274-e0db-4bea-96ce-6c130b4c5d5c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031898 Aug 24 03:45:54.606102 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 509/1007] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:47:04.592272 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:47:04.592890 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Wed Aug 24 03:47:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:47:28.332488 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7ecc4895-c02b-4b0d-bee9-d435f39ec73a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-899158707", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1735211970", "security_groups": [{"name": "tempest-secgroup-smoke-573258359"}], "block_device_mapping_v2": [{"uuid": "bbea75fa-0b35-455e-b91a-f32065e084b3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a77328d1-9351-48c2-a2f3-0639347291ff"}]}} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:47:28.342577 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=26 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:28.343352 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=62 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:28.450993 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.network.neutron [None req-7ecc4895-c02b-4b0d-bee9-d435f39ec73a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] validate_networks() for [('a77328d1-9351-48c2-a2f3-0639347291ff', None, None, None, None, None)] {{(pid=120708) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:47:28.825095 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-7ecc4895-c02b-4b0d-bee9-d435f39ec73a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Flavor limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:47:28.825526 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-7ecc4895-c02b-4b0d-bee9-d435f39ec73a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Image limits 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:47:28.826004 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-7ecc4895-c02b-4b0d-bee9-d435f39ec73a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Flavor pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:47:28.826418 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-7ecc4895-c02b-4b0d-bee9-d435f39ec73a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Image pref 0:0:0 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:47:28.826832 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.virt.hardware [None req-7ecc4895-c02b-4b0d-bee9-d435f39ec73a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120708) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:47:28.835896 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7ecc4895-c02b-4b0d-bee9-d435f39ec73a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:28.836384 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7ecc4895-c02b-4b0d-bee9-d435f39ec73a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:28.836918 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7ecc4895-c02b-4b0d-bee9-d435f39ec73a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:28.837645 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7ecc4895-c02b-4b0d-bee9-d435f39ec73a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:28.838102 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7ecc4895-c02b-4b0d-bee9-d435f39ec73a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:28.838524 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7ecc4895-c02b-4b0d-bee9-d435f39ec73a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:28.854739 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-7ecc4895-c02b-4b0d-bee9-d435f39ec73a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Getting quotas for project c742ff2fa942409384b6294cf883ce0a. Resources: {'ram', 'instances', 'cores'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:47:28.858636 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.quota [None req-7ecc4895-c02b-4b0d-bee9-d435f39ec73a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Getting quotas for user d32bf7e9512f4a51ae52a25bba18b891 and project c742ff2fa942409384b6294cf883ce0a. Resources: {'ram', 'instances', 'cores'} {{(pid=120708) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:47:28.915496 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-7ecc4895-c02b-4b0d-bee9-d435f39ec73a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Going to run 1 instances... {{(pid=120708) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:47:28.917668 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-7ecc4895-c02b-4b0d-bee9-d435f39ec73a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 70822538-7cb5-493a-910e-9644ae2c9ddb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bbea75fa-0b35-455e-b91a-f32065e084b3',volume_size=None,volume_type=None)] {{(pid=120708) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:47:29.049851 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-7ecc4895-c02b-4b0d-bee9-d435f39ec73a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.722300 Aug 24 03:47:29.050498 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 499/1008] 10.222.0.81 () {60 vars in 1147 bytes} [Wed Aug 24 03:47:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:47:29.060026 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:29.060789 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:29.066884 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-616c301a-bf80-4c59-830b-cee0dca8bdee tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:29.067684 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-616c301a-bf80-4c59-830b-cee0dca8bdee tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 70822538-7cb5-493a-910e-9644ae2c9ddb] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:29.131172 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-616c301a-bf80-4c59-830b-cee0dca8bdee tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:29.138216 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-616c301a-bf80-4c59-830b-cee0dca8bdee tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb" status: 200 len: 1094 microversion: 2.1 time: 0.080492 Aug 24 03:47:29.138765 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 510/1009] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:29 2022] GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb => generated 1094 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:47:30.161065 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-2af652dd-7133-4aee-adab-4c8b0b42480b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:30.161752 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-2af652dd-7133-4aee-adab-4c8b0b42480b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 70822538-7cb5-493a-910e-9644ae2c9ddb] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:30.169267 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2af652dd-7133-4aee-adab-4c8b0b42480b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:30.169835 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2af652dd-7133-4aee-adab-4c8b0b42480b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:30.170365 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2af652dd-7133-4aee-adab-4c8b0b42480b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:30.171258 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2af652dd-7133-4aee-adab-4c8b0b42480b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:30.171984 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2af652dd-7133-4aee-adab-4c8b0b42480b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:30.173301 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-2af652dd-7133-4aee-adab-4c8b0b42480b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:30.241419 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-2af652dd-7133-4aee-adab-4c8b0b42480b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:30.249110 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-2af652dd-7133-4aee-adab-4c8b0b42480b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb" status: 200 len: 1210 microversion: 2.1 time: 0.094055 Aug 24 03:47:30.249681 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 500/1010] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:30 2022] GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb => generated 1210 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:31.270153 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-9a0b573f-3a6b-4365-9528-86ac882496a7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:31.270775 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-9a0b573f-3a6b-4365-9528-86ac882496a7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 70822538-7cb5-493a-910e-9644ae2c9ddb] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:31.278059 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9a0b573f-3a6b-4365-9528-86ac882496a7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:31.278556 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9a0b573f-3a6b-4365-9528-86ac882496a7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:31.279199 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9a0b573f-3a6b-4365-9528-86ac882496a7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:31.279920 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9a0b573f-3a6b-4365-9528-86ac882496a7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:31.280386 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9a0b573f-3a6b-4365-9528-86ac882496a7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:31.280852 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-9a0b573f-3a6b-4365-9528-86ac882496a7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:31.417733 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-9a0b573f-3a6b-4365-9528-86ac882496a7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:31.425955 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-9a0b573f-3a6b-4365-9528-86ac882496a7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb" status: 200 len: 1265 microversion: 2.1 time: 0.160274 Aug 24 03:47:31.426560 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 511/1011] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:31 2022] GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:31.528358 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-9ec817df-0183-4ecd-9a49-169f2948b125 req-fa977f42-e8a8-44a7-91ac-5e462e5ce5a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70822538-7cb5-493a-910e-9644ae2c9ddb", "tag": "be6c9f71-e72c-4f92-8296-06b8917da25b"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:47:31.538145 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-9ec817df-0183-4ecd-9a49-169f2948b125 req-fa977f42-e8a8-44a7-91ac-5e462e5ce5a1 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:31.538696 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-9ec817df-0183-4ecd-9a49-169f2948b125 req-fa977f42-e8a8-44a7-91ac-5e462e5ce5a1 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:31.539190 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-9ec817df-0183-4ecd-9a49-169f2948b125 req-fa977f42-e8a8-44a7-91ac-5e462e5ce5a1 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:31.550208 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-9ec817df-0183-4ecd-9a49-169f2948b125 req-fa977f42-e8a8-44a7-91ac-5e462e5ce5a1 service nova] Creating event network-changed:be6c9f71-e72c-4f92-8296-06b8917da25b for instance 70822538-7cb5-493a-910e-9644ae2c9ddb on hv-cinder-85426 Aug 24 03:47:31.555209 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-9ec817df-0183-4ecd-9a49-169f2948b125 req-fa977f42-e8a8-44a7-91ac-5e462e5ce5a1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094887 Aug 24 03:47:31.556152 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 501/1012] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:47:32.446502 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-c3be10b2-12e4-459d-89c7-dee592433f65 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:32.447120 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-c3be10b2-12e4-459d-89c7-dee592433f65 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 70822538-7cb5-493a-910e-9644ae2c9ddb] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:32.454073 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c3be10b2-12e4-459d-89c7-dee592433f65 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:32.454564 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c3be10b2-12e4-459d-89c7-dee592433f65 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:32.455007 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c3be10b2-12e4-459d-89c7-dee592433f65 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:32.455713 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c3be10b2-12e4-459d-89c7-dee592433f65 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:32.456177 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c3be10b2-12e4-459d-89c7-dee592433f65 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:32.456607 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c3be10b2-12e4-459d-89c7-dee592433f65 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:32.589668 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-c3be10b2-12e4-459d-89c7-dee592433f65 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:32.598622 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-c3be10b2-12e4-459d-89c7-dee592433f65 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb" status: 200 len: 1265 microversion: 2.1 time: 0.156013 Aug 24 03:47:32.599280 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 512/1013] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:32 2022] GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:33.620304 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-800aae46-97cf-4813-a9fd-38e5c9523cf3 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:33.621040 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-800aae46-97cf-4813-a9fd-38e5c9523cf3 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 70822538-7cb5-493a-910e-9644ae2c9ddb] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:33.627661 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-800aae46-97cf-4813-a9fd-38e5c9523cf3 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:33.628146 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-800aae46-97cf-4813-a9fd-38e5c9523cf3 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:33.628584 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-800aae46-97cf-4813-a9fd-38e5c9523cf3 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:33.629446 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-800aae46-97cf-4813-a9fd-38e5c9523cf3 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:33.630220 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-800aae46-97cf-4813-a9fd-38e5c9523cf3 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:33.630945 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-800aae46-97cf-4813-a9fd-38e5c9523cf3 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:33.780293 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-800aae46-97cf-4813-a9fd-38e5c9523cf3 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:33.788973 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-800aae46-97cf-4813-a9fd-38e5c9523cf3 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb" status: 200 len: 1265 microversion: 2.1 time: 0.173219 Aug 24 03:47:33.789539 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 502/1014] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:33 2022] GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:34.811282 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-49a61047-f5a6-4b7f-9e90-9068c3d9a1f5 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:34.811823 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-49a61047-f5a6-4b7f-9e90-9068c3d9a1f5 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 70822538-7cb5-493a-910e-9644ae2c9ddb] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:34.818902 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-49a61047-f5a6-4b7f-9e90-9068c3d9a1f5 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:34.819388 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-49a61047-f5a6-4b7f-9e90-9068c3d9a1f5 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:34.819828 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-49a61047-f5a6-4b7f-9e90-9068c3d9a1f5 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:34.820516 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-49a61047-f5a6-4b7f-9e90-9068c3d9a1f5 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:34.821003 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-49a61047-f5a6-4b7f-9e90-9068c3d9a1f5 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:34.821432 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-49a61047-f5a6-4b7f-9e90-9068c3d9a1f5 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:34.957319 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-49a61047-f5a6-4b7f-9e90-9068c3d9a1f5 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:34.965122 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-49a61047-f5a6-4b7f-9e90-9068c3d9a1f5 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb" status: 200 len: 1265 microversion: 2.1 time: 0.158670 Aug 24 03:47:34.965673 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 513/1015] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:34 2022] GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:35.985614 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-14421d27-1602-441a-bd4b-68baefacad4c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:35.986444 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-14421d27-1602-441a-bd4b-68baefacad4c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 70822538-7cb5-493a-910e-9644ae2c9ddb] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:35.993022 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-14421d27-1602-441a-bd4b-68baefacad4c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:35.993504 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-14421d27-1602-441a-bd4b-68baefacad4c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:35.993935 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-14421d27-1602-441a-bd4b-68baefacad4c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:35.994648 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-14421d27-1602-441a-bd4b-68baefacad4c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:35.995105 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-14421d27-1602-441a-bd4b-68baefacad4c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:35.995523 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-14421d27-1602-441a-bd4b-68baefacad4c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:36.131212 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-14421d27-1602-441a-bd4b-68baefacad4c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:36.138731 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-14421d27-1602-441a-bd4b-68baefacad4c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb" status: 200 len: 1265 microversion: 2.1 time: 0.157487 Aug 24 03:47:36.139284 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 503/1016] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:35 2022] GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:37.159645 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-2653db7a-f820-4ecb-bed9-26b6e05972aa tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:37.160249 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-2653db7a-f820-4ecb-bed9-26b6e05972aa tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 70822538-7cb5-493a-910e-9644ae2c9ddb] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:37.166618 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2653db7a-f820-4ecb-bed9-26b6e05972aa tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:37.167045 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2653db7a-f820-4ecb-bed9-26b6e05972aa tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:37.167483 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2653db7a-f820-4ecb-bed9-26b6e05972aa tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:37.168170 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2653db7a-f820-4ecb-bed9-26b6e05972aa tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:37.168626 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2653db7a-f820-4ecb-bed9-26b6e05972aa tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:37.169087 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-2653db7a-f820-4ecb-bed9-26b6e05972aa tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:37.305909 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-2653db7a-f820-4ecb-bed9-26b6e05972aa tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:37.314297 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-2653db7a-f820-4ecb-bed9-26b6e05972aa tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb" status: 200 len: 1265 microversion: 2.1 time: 0.158541 Aug 24 03:47:37.314851 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 514/1017] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:37 2022] GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:38.335185 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-e65f5675-895b-41fb-ac4e-8045fa998464 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:38.336126 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-e65f5675-895b-41fb-ac4e-8045fa998464 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 70822538-7cb5-493a-910e-9644ae2c9ddb] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:38.342630 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e65f5675-895b-41fb-ac4e-8045fa998464 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:38.343115 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e65f5675-895b-41fb-ac4e-8045fa998464 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:38.343598 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e65f5675-895b-41fb-ac4e-8045fa998464 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:38.344394 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e65f5675-895b-41fb-ac4e-8045fa998464 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:38.344877 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e65f5675-895b-41fb-ac4e-8045fa998464 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:38.345307 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-e65f5675-895b-41fb-ac4e-8045fa998464 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:38.480947 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-e65f5675-895b-41fb-ac4e-8045fa998464 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:38.489874 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-e65f5675-895b-41fb-ac4e-8045fa998464 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb" status: 200 len: 1265 microversion: 2.1 time: 0.158567 Aug 24 03:47:38.490453 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 504/1018] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:38 2022] GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:39.511869 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-f4350e67-d57a-480d-9ecd-49436ed35f8b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:39.512555 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-f4350e67-d57a-480d-9ecd-49436ed35f8b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 70822538-7cb5-493a-910e-9644ae2c9ddb] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:39.515166 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell0:SELECT=2 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:39.521136 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f4350e67-d57a-480d-9ecd-49436ed35f8b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:39.521713 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f4350e67-d57a-480d-9ecd-49436ed35f8b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:39.522182 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f4350e67-d57a-480d-9ecd-49436ed35f8b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:39.522968 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f4350e67-d57a-480d-9ecd-49436ed35f8b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:39.523456 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f4350e67-d57a-480d-9ecd-49436ed35f8b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:39.523915 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f4350e67-d57a-480d-9ecd-49436ed35f8b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:39.668526 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-f4350e67-d57a-480d-9ecd-49436ed35f8b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:39.678109 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-f4350e67-d57a-480d-9ecd-49436ed35f8b tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb" status: 200 len: 1265 microversion: 2.1 time: 0.170394 Aug 24 03:47:39.678780 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 515/1019] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:39 2022] GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:40.698677 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-f2e65394-97ba-4a7d-9779-766ec8f4d31a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:40.699329 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-f2e65394-97ba-4a7d-9779-766ec8f4d31a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 70822538-7cb5-493a-910e-9644ae2c9ddb] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:40.701320 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=2 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:40.702007 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell0:SELECT=6 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:40.709779 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f2e65394-97ba-4a7d-9779-766ec8f4d31a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:40.710527 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f2e65394-97ba-4a7d-9779-766ec8f4d31a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:40.711303 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f2e65394-97ba-4a7d-9779-766ec8f4d31a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:40.712008 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f2e65394-97ba-4a7d-9779-766ec8f4d31a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:40.712576 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f2e65394-97ba-4a7d-9779-766ec8f4d31a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:40.713352 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-f2e65394-97ba-4a7d-9779-766ec8f4d31a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:40.848788 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-f2e65394-97ba-4a7d-9779-766ec8f4d31a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:40.856442 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-f2e65394-97ba-4a7d-9779-766ec8f4d31a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb" status: 200 len: 1265 microversion: 2.1 time: 0.161748 Aug 24 03:47:40.857026 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 505/1020] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:40 2022] GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:41.769051 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-2aaae621-eb7e-4dd3-8816-8defc9b1596e req-ad858a5e-8e70-432d-89ca-aab34132573e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70822538-7cb5-493a-910e-9644ae2c9ddb", "name": "network-vif-plugged", "status": "completed", "tag": "be6c9f71-e72c-4f92-8296-06b8917da25b"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:47:41.780248 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-2aaae621-eb7e-4dd3-8816-8defc9b1596e req-ad858a5e-8e70-432d-89ca-aab34132573e service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:41.780401 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-2aaae621-eb7e-4dd3-8816-8defc9b1596e req-ad858a5e-8e70-432d-89ca-aab34132573e service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:41.780753 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-2aaae621-eb7e-4dd3-8816-8defc9b1596e req-ad858a5e-8e70-432d-89ca-aab34132573e service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:41.792529 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-2aaae621-eb7e-4dd3-8816-8defc9b1596e req-ad858a5e-8e70-432d-89ca-aab34132573e service nova] Creating event network-vif-plugged:be6c9f71-e72c-4f92-8296-06b8917da25b for instance 70822538-7cb5-493a-910e-9644ae2c9ddb on hv-cinder-85426 Aug 24 03:47:41.797557 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-2aaae621-eb7e-4dd3-8816-8defc9b1596e req-ad858a5e-8e70-432d-89ca-aab34132573e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033429 Aug 24 03:47:41.798144 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 516/1021] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:47:41.877109 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-7e519c23-0f42-4a21-bb7c-9dde7afdda84 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:41.877721 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-7e519c23-0f42-4a21-bb7c-9dde7afdda84 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 70822538-7cb5-493a-910e-9644ae2c9ddb] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:41.884028 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7e519c23-0f42-4a21-bb7c-9dde7afdda84 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:41.884515 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7e519c23-0f42-4a21-bb7c-9dde7afdda84 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:41.884997 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7e519c23-0f42-4a21-bb7c-9dde7afdda84 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:41.885693 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7e519c23-0f42-4a21-bb7c-9dde7afdda84 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:41.886150 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7e519c23-0f42-4a21-bb7c-9dde7afdda84 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:41.886578 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-7e519c23-0f42-4a21-bb7c-9dde7afdda84 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:42.017809 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-7e519c23-0f42-4a21-bb7c-9dde7afdda84 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:42.025592 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-7e519c23-0f42-4a21-bb7c-9dde7afdda84 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb" status: 200 len: 1265 microversion: 2.1 time: 0.152997 Aug 24 03:47:42.026158 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 506/1022] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:41 2022] GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:43.048465 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-f0e24531-3c1a-4cca-8c32-3e4356a212e6 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:43.049230 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-f0e24531-3c1a-4cca-8c32-3e4356a212e6 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 70822538-7cb5-493a-910e-9644ae2c9ddb] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:43.055298 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f0e24531-3c1a-4cca-8c32-3e4356a212e6 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:43.055783 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f0e24531-3c1a-4cca-8c32-3e4356a212e6 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:43.056222 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f0e24531-3c1a-4cca-8c32-3e4356a212e6 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:43.056954 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f0e24531-3c1a-4cca-8c32-3e4356a212e6 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:43.057423 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f0e24531-3c1a-4cca-8c32-3e4356a212e6 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:43.057851 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-f0e24531-3c1a-4cca-8c32-3e4356a212e6 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:43.191550 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-f0e24531-3c1a-4cca-8c32-3e4356a212e6 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:43.199101 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-f0e24531-3c1a-4cca-8c32-3e4356a212e6 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb" status: 200 len: 1265 microversion: 2.1 time: 0.155828 Aug 24 03:47:43.199664 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 517/1023] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:43 2022] GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:44.220671 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-57a6985d-9769-4f92-b0b1-83d0fa072ddb tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:44.221231 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-57a6985d-9769-4f92-b0b1-83d0fa072ddb tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 70822538-7cb5-493a-910e-9644ae2c9ddb] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:44.227607 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57a6985d-9769-4f92-b0b1-83d0fa072ddb tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:44.228101 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57a6985d-9769-4f92-b0b1-83d0fa072ddb tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:44.228537 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57a6985d-9769-4f92-b0b1-83d0fa072ddb tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:44.229585 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57a6985d-9769-4f92-b0b1-83d0fa072ddb tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:44.231269 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57a6985d-9769-4f92-b0b1-83d0fa072ddb tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:44.231706 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-57a6985d-9769-4f92-b0b1-83d0fa072ddb tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:44.365256 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-57a6985d-9769-4f92-b0b1-83d0fa072ddb tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:44.372907 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-57a6985d-9769-4f92-b0b1-83d0fa072ddb tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb" status: 200 len: 1451 microversion: 2.1 time: 0.156724 Aug 24 03:47:44.373471 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 507/1024] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:44 2022] GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:44.394294 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-b7bf819e-c04a-4e47-bdf4-bf101b1b67a9 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:47:44.394902 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-b7bf819e-c04a-4e47-bdf4-bf101b1b67a9 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 70822538-7cb5-493a-910e-9644ae2c9ddb] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:47:44.401229 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b7bf819e-c04a-4e47-bdf4-bf101b1b67a9 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:44.401709 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b7bf819e-c04a-4e47-bdf4-bf101b1b67a9 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:44.402145 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b7bf819e-c04a-4e47-bdf4-bf101b1b67a9 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:44.402831 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b7bf819e-c04a-4e47-bdf4-bf101b1b67a9 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:44.403285 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b7bf819e-c04a-4e47-bdf4-bf101b1b67a9 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:44.403729 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-b7bf819e-c04a-4e47-bdf4-bf101b1b67a9 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:44.540200 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-b7bf819e-c04a-4e47-bdf4-bf101b1b67a9 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:47:44.549191 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-b7bf819e-c04a-4e47-bdf4-bf101b1b67a9 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb" status: 200 len: 1451 microversion: 2.1 time: 0.159537 Aug 24 03:47:44.549753 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 518/1025] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:47:44 2022] GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:47:46.353204 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-e25c0bd1-f4ac-499a-9349-637f4d173312 req-9b90e40f-990f-4768-b9cb-de59c63a4135 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70822538-7cb5-493a-910e-9644ae2c9ddb", "tag": "be6c9f71-e72c-4f92-8296-06b8917da25b"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:47:46.364584 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-e25c0bd1-f4ac-499a-9349-637f4d173312 req-9b90e40f-990f-4768-b9cb-de59c63a4135 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:46.365175 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-e25c0bd1-f4ac-499a-9349-637f4d173312 req-9b90e40f-990f-4768-b9cb-de59c63a4135 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:46.365690 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-e25c0bd1-f4ac-499a-9349-637f4d173312 req-9b90e40f-990f-4768-b9cb-de59c63a4135 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:46.378553 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-e25c0bd1-f4ac-499a-9349-637f4d173312 req-9b90e40f-990f-4768-b9cb-de59c63a4135 service nova] Creating event network-changed:be6c9f71-e72c-4f92-8296-06b8917da25b for instance 70822538-7cb5-493a-910e-9644ae2c9ddb on hv-cinder-85426 Aug 24 03:47:46.383698 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-e25c0bd1-f4ac-499a-9349-637f4d173312 req-9b90e40f-990f-4768-b9cb-de59c63a4135 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034129 Aug 24 03:47:46.384301 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 508/1026] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:48:13.051558 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:48:13.052115 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Wed Aug 24 03:48:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:48:36.366276 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:48:36.367256 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Wed Aug 24 03:48:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:49:25.776825 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:25.777582 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG dbcounter [-] [120708] Writing DB stats nova_cell1:SELECT=48 {{(pid=120708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:25.782117 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-8f7a0522-180c-4d47-a64f-fba4c0930291 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:25.782610 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-8f7a0522-180c-4d47-a64f-fba4c0930291 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 70822538-7cb5-493a-910e-9644ae2c9ddb] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:25.784661 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_api:SELECT=20 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:25.789993 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-8ef1a6eb-0cd1-419f-aace-84f1c6541c20 req-4732de5d-8e03-4807-b631-97e36ab522d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70822538-7cb5-493a-910e-9644ae2c9ddb", "tag": "be6c9f71-e72c-4f92-8296-06b8917da25b"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:25.791128 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG dbcounter [-] [120709] Writing DB stats nova_cell1:SELECT=44 {{(pid=120709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:25.797171 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8f7a0522-180c-4d47-a64f-fba4c0930291 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:25.797676 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8f7a0522-180c-4d47-a64f-fba4c0930291 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:25.798121 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8f7a0522-180c-4d47-a64f-fba4c0930291 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:25.798828 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8f7a0522-180c-4d47-a64f-fba4c0930291 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:25.799284 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8f7a0522-180c-4d47-a64f-fba4c0930291 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:25.799710 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-8f7a0522-180c-4d47-a64f-fba4c0930291 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:25.811607 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-8ef1a6eb-0cd1-419f-aace-84f1c6541c20 req-4732de5d-8e03-4807-b631-97e36ab522d4 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:25.812090 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-8ef1a6eb-0cd1-419f-aace-84f1c6541c20 req-4732de5d-8e03-4807-b631-97e36ab522d4 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:25.812781 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-8ef1a6eb-0cd1-419f-aace-84f1c6541c20 req-4732de5d-8e03-4807-b631-97e36ab522d4 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:25.824709 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-8ef1a6eb-0cd1-419f-aace-84f1c6541c20 req-4732de5d-8e03-4807-b631-97e36ab522d4 service nova] Creating event network-changed:be6c9f71-e72c-4f92-8296-06b8917da25b for instance 70822538-7cb5-493a-910e-9644ae2c9ddb on hv-cinder-85426 Aug 24 03:49:25.830727 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-8ef1a6eb-0cd1-419f-aace-84f1c6541c20 req-4732de5d-8e03-4807-b631-97e36ab522d4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055872 Aug 24 03:49:25.831702 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 509/1027] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:49:25.832278 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-8f7a0522-180c-4d47-a64f-fba4c0930291 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 70822538-7cb5-493a-910e-9644ae2c9ddb] Going to try to terminate instance {{(pid=120709) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:49:25.924730 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-8f7a0522-180c-4d47-a64f-fba4c0930291 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "DELETE /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb" status: 204 len: 0 microversion: 2.1 time: 0.151682 Aug 24 03:49:25.929283 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 519/1028] 10.222.0.81 () {58 vars in 1239 bytes} [Wed Aug 24 03:49:25 2022] DELETE /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:49:25.939373 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1626be46-cade-4926-b791-4bb93ba3d65d tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:25.940213 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1626be46-cade-4926-b791-4bb93ba3d65d tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 70822538-7cb5-493a-910e-9644ae2c9ddb] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:25.947514 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1626be46-cade-4926-b791-4bb93ba3d65d tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:25.948075 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1626be46-cade-4926-b791-4bb93ba3d65d tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:25.948584 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1626be46-cade-4926-b791-4bb93ba3d65d tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:25.949320 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1626be46-cade-4926-b791-4bb93ba3d65d tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:25.949774 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1626be46-cade-4926-b791-4bb93ba3d65d tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:25.950238 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1626be46-cade-4926-b791-4bb93ba3d65d tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:26.085472 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-1626be46-cade-4926-b791-4bb93ba3d65d tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:26.094599 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1626be46-cade-4926-b791-4bb93ba3d65d tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb" status: 200 len: 1575 microversion: 2.1 time: 0.161816 Aug 24 03:49:26.095192 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 510/1029] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:25 2022] GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:27.116595 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-cc30c0a1-ebd1-4ff2-ae70-056b1031dc2e tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:27.117310 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-cc30c0a1-ebd1-4ff2-ae70-056b1031dc2e tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 70822538-7cb5-493a-910e-9644ae2c9ddb] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:27.124330 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cc30c0a1-ebd1-4ff2-ae70-056b1031dc2e tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:27.124842 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cc30c0a1-ebd1-4ff2-ae70-056b1031dc2e tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:27.125277 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cc30c0a1-ebd1-4ff2-ae70-056b1031dc2e tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:27.125961 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cc30c0a1-ebd1-4ff2-ae70-056b1031dc2e tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:27.126409 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cc30c0a1-ebd1-4ff2-ae70-056b1031dc2e tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:27.126828 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-cc30c0a1-ebd1-4ff2-ae70-056b1031dc2e tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:27.264068 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-cc30c0a1-ebd1-4ff2-ae70-056b1031dc2e tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:27.271876 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-cc30c0a1-ebd1-4ff2-ae70-056b1031dc2e tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb" status: 200 len: 1575 microversion: 2.1 time: 0.159414 Aug 24 03:49:27.272448 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 520/1030] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:27 2022] GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:28.300147 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-ffc1c3c6-56b8-4148-914c-f0464cfe47e7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:28.301055 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-ffc1c3c6-56b8-4148-914c-f0464cfe47e7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 70822538-7cb5-493a-910e-9644ae2c9ddb] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:28.308957 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ffc1c3c6-56b8-4148-914c-f0464cfe47e7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:28.309903 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ffc1c3c6-56b8-4148-914c-f0464cfe47e7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:28.309903 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ffc1c3c6-56b8-4148-914c-f0464cfe47e7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:28.312090 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ffc1c3c6-56b8-4148-914c-f0464cfe47e7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:28.312356 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ffc1c3c6-56b8-4148-914c-f0464cfe47e7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:28.312615 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-ffc1c3c6-56b8-4148-914c-f0464cfe47e7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:28.387914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-ffc1c3c6-56b8-4148-914c-f0464cfe47e7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:28.397320 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [req-558fcd6b-2ca2-4ca4-aa16-2a093cb94f49 req-526df1fb-1caa-4058-8e40-b6a024d935e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70822538-7cb5-493a-910e-9644ae2c9ddb", "name": "network-vif-deleted", "tag": "be6c9f71-e72c-4f92-8296-06b8917da25b"}]} {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:28.397901 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-ffc1c3c6-56b8-4148-914c-f0464cfe47e7 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb" status: 200 len: 1390 microversion: 2.1 time: 0.104191 Aug 24 03:49:28.398363 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 511/1031] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:28 2022] GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb => generated 1390 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:28.407078 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-558fcd6b-2ca2-4ca4-aa16-2a093cb94f49 req-526df1fb-1caa-4058-8e40-b6a024d935e7 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:28.407573 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-558fcd6b-2ca2-4ca4-aa16-2a093cb94f49 req-526df1fb-1caa-4058-8e40-b6a024d935e7 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:28.408015 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [req-558fcd6b-2ca2-4ca4-aa16-2a093cb94f49 req-526df1fb-1caa-4058-8e40-b6a024d935e7 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:28.422953 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.compute.server_external_events [req-558fcd6b-2ca2-4ca4-aa16-2a093cb94f49 req-526df1fb-1caa-4058-8e40-b6a024d935e7 service nova] Creating event network-vif-deleted:be6c9f71-e72c-4f92-8296-06b8917da25b for instance 70822538-7cb5-493a-910e-9644ae2c9ddb on hv-cinder-85426 Aug 24 03:49:28.428341 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [req-558fcd6b-2ca2-4ca4-aa16-2a093cb94f49 req-526df1fb-1caa-4058-8e40-b6a024d935e7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034528 Aug 24 03:49:28.429002 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 521/1032] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:49:29.419044 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1175cc05-7e3a-4e62-b899-712fa5a92d6c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:29.419729 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-1175cc05-7e3a-4e62-b899-712fa5a92d6c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 70822538-7cb5-493a-910e-9644ae2c9ddb] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:29.426440 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1175cc05-7e3a-4e62-b899-712fa5a92d6c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:29.426926 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1175cc05-7e3a-4e62-b899-712fa5a92d6c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:29.427358 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1175cc05-7e3a-4e62-b899-712fa5a92d6c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:29.428115 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1175cc05-7e3a-4e62-b899-712fa5a92d6c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:29.428568 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1175cc05-7e3a-4e62-b899-712fa5a92d6c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:29.429028 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-1175cc05-7e3a-4e62-b899-712fa5a92d6c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:29.445524 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-1175cc05-7e3a-4e62-b899-712fa5a92d6c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] HTTP exception thrown: Instance 70822538-7cb5-493a-910e-9644ae2c9ddb could not be found. Aug 24 03:49:29.447150 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1175cc05-7e3a-4e62-b899-712fa5a92d6c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Request method failure captured: Aug 24 03:49:29.447150 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb HTTP/1.1 Aug 24 03:49:29.447150 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 24 03:49:29.447150 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 24 03:49:29.447150 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Connection: close Aug 24 03:49:29.447150 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 24 03:49:29.447150 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 24 03:49:29.447150 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Host: 10.222.0.81 Aug 24 03:49:29.447150 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 24 03:49:29.447150 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.11 Aug 24 03:49:29.447150 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjBZ5C5Nyg8blEXeQ_OHyi5xfYVpO3ig_gkwsF4RFVgwvEzGzV-XFbKVcFKZeFMHVff9N1OWdpi9vsFospfdzuJ83C1kje2npifOEb7U4FJi_x5Md2OccxsavbDIUuhhH78RjOLkk374i-zeJXK5adKH0abQLWM6i6GnUazmWWqKDZqpY Aug 24 03:49:29.447150 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 24 03:49:29.447150 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 24 03:49:29.447150 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 24 03:49:29.447150 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 24 03:49:29.447150 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 24 03:49:29.447150 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 24 03:49:29.447150 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Id: c742ff2fa942409384b6294cf883ce0a Aug 24 03:49:29.447150 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-TestVolumeBootPattern-212920611 Aug 24 03:49:29.447150 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 24 03:49:29.447150 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 24 03:49:29.448914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c742ff2fa942409384b6294cf883ce0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_c742ff2fa942409384b6294cf883ce0a", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c742ff2fa942409384b6294cf883ce0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/c742ff2fa942409384b6294cf883ce0a"}]}] Aug 24 03:49:29.448914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-TestVolumeBootPattern-212920611 Aug 24 03:49:29.448914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Id: c742ff2fa942409384b6294cf883ce0a Aug 24 03:49:29.448914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-TestVolumeBootPattern-212920611 Aug 24 03:49:29.448914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User: tempest-TestVolumeBootPattern-212920611-project Aug 24 03:49:29.448914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 24 03:49:29.448914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 24 03:49:29.448914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Id: d32bf7e9512f4a51ae52a25bba18b891 Aug 24 03:49:29.448914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-TestVolumeBootPattern-212920611-project Aug 24 03:49:29.448914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: method: > Aug 24 03:49:29.448914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: exception: Instance 70822538-7cb5-493a-910e-9644ae2c9ddb could not be found. Aug 24 03:49:29.448914 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: action_args: {'id': '70822538-7cb5-493a-910e-9644ae2c9ddb'} Aug 24 03:49:29.449813 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:49:29.449813 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:29.449813 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:49:29.449813 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:49:29.449813 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:49:29.449813 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:49:29.449813 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:49:29.449813 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:49:29.449813 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:49:29.449813 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:49:29.449813 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70822538-7cb5-493a-910e-9644ae2c9ddb could not be found. Aug 24 03:49:29.449813 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:49:29.449813 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:49:29.449813 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:49:29.449813 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:29.449813 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:49:29.449813 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:49:29.449813 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:49:29.449813 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:49:29.449813 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:49:29.451880 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:49:29.451880 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:49:29.451880 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:49:29.451880 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:49:29.451880 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:49:29.451880 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:49:29.451880 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:49:29.451880 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70822538-7cb5-493a-910e-9644ae2c9ddb could not be found. Aug 24 03:49:29.451880 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:49:29.451880 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:49:29.451880 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:49:29.451880 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:29.451880 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:49:29.451880 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:49:29.451880 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:49:29.451880 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:49:29.451880 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70822538-7cb5-493a-910e-9644ae2c9ddb could not be found. Aug 24 03:49:29.451880 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:49:29.453348 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-1175cc05-7e3a-4e62-b899-712fa5a92d6c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Returning 404 to user: Instance 70822538-7cb5-493a-910e-9644ae2c9ddb could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:49:29.453348 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-1175cc05-7e3a-4e62-b899-712fa5a92d6c tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb" status: 404 len: 111 microversion: 2.1 time: 0.033413 Aug 24 03:49:29.453348 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 512/1033] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:29 2022] GET /compute/v2.1/servers/70822538-7cb5-493a-910e-9644ae2c9ddb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:49:32.513096 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-e3cb588a-063a-4448-b9e4-0a9d18ed4e40 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:32.514231 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-e3cb588a-063a-4448-b9e4-0a9d18ed4e40 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 98a71e9c-31b1-4efe-9580-1aeb161cb712] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:32.515253 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-1e578afa-1aea-4877-9c12-39a36090ad85 req-7b8d0e26-772f-4380-a63e-779a6e2e9589 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98a71e9c-31b1-4efe-9580-1aeb161cb712", "tag": "94e62715-a19a-4e2c-9d13-d5ced48f4941"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:32.520749 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e3cb588a-063a-4448-b9e4-0a9d18ed4e40 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:32.521272 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e3cb588a-063a-4448-b9e4-0a9d18ed4e40 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:32.521710 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e3cb588a-063a-4448-b9e4-0a9d18ed4e40 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:32.522399 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e3cb588a-063a-4448-b9e4-0a9d18ed4e40 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:32.523069 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e3cb588a-063a-4448-b9e4-0a9d18ed4e40 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:32.523497 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-e3cb588a-063a-4448-b9e4-0a9d18ed4e40 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:32.525566 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-1e578afa-1aea-4877-9c12-39a36090ad85 req-7b8d0e26-772f-4380-a63e-779a6e2e9589 service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:32.526204 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-1e578afa-1aea-4877-9c12-39a36090ad85 req-7b8d0e26-772f-4380-a63e-779a6e2e9589 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:32.526679 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-1e578afa-1aea-4877-9c12-39a36090ad85 req-7b8d0e26-772f-4380-a63e-779a6e2e9589 service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:32.539450 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-1e578afa-1aea-4877-9c12-39a36090ad85 req-7b8d0e26-772f-4380-a63e-779a6e2e9589 service nova] Creating event network-changed:94e62715-a19a-4e2c-9d13-d5ced48f4941 for instance 98a71e9c-31b1-4efe-9580-1aeb161cb712 on hv-cinder-85426 Aug 24 03:49:32.544907 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-1e578afa-1aea-4877-9c12-39a36090ad85 req-7b8d0e26-772f-4380-a63e-779a6e2e9589 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034392 Aug 24 03:49:32.545549 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 513/1034] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:49:32.550968 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-e3cb588a-063a-4448-b9e4-0a9d18ed4e40 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 98a71e9c-31b1-4efe-9580-1aeb161cb712] Going to try to terminate instance {{(pid=120709) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:49:32.646005 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-e3cb588a-063a-4448-b9e4-0a9d18ed4e40 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "DELETE /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712" status: 204 len: 0 microversion: 2.1 time: 0.137748 Aug 24 03:49:32.646593 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 522/1035] 10.222.0.81 () {58 vars in 1239 bytes} [Wed Aug 24 03:49:32 2022] DELETE /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:49:32.655279 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-b9e17c43-c4a3-4e63-8a03-a9dc8c7c2469 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:32.655974 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-b9e17c43-c4a3-4e63-8a03-a9dc8c7c2469 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 98a71e9c-31b1-4efe-9580-1aeb161cb712] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:32.662161 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b9e17c43-c4a3-4e63-8a03-a9dc8c7c2469 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:32.662651 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b9e17c43-c4a3-4e63-8a03-a9dc8c7c2469 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:32.663090 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b9e17c43-c4a3-4e63-8a03-a9dc8c7c2469 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:32.663784 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b9e17c43-c4a3-4e63-8a03-a9dc8c7c2469 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:32.664242 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b9e17c43-c4a3-4e63-8a03-a9dc8c7c2469 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:32.664669 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-b9e17c43-c4a3-4e63-8a03-a9dc8c7c2469 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:32.803950 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.policy [None req-b9e17c43-c4a3-4e63-8a03-a9dc8c7c2469 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120708) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:32.812217 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-b9e17c43-c4a3-4e63-8a03-a9dc8c7c2469 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712" status: 200 len: 1578 microversion: 2.1 time: 0.161069 Aug 24 03:49:32.812697 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 514/1036] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:32 2022] GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712 => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:33.833223 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-1fd41435-17ce-4d20-94e6-0eaa59b742b2 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:33.833932 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-1fd41435-17ce-4d20-94e6-0eaa59b742b2 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 98a71e9c-31b1-4efe-9580-1aeb161cb712] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:33.840420 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1fd41435-17ce-4d20-94e6-0eaa59b742b2 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:33.840965 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1fd41435-17ce-4d20-94e6-0eaa59b742b2 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:33.841524 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1fd41435-17ce-4d20-94e6-0eaa59b742b2 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:33.842264 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1fd41435-17ce-4d20-94e6-0eaa59b742b2 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:33.842723 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1fd41435-17ce-4d20-94e6-0eaa59b742b2 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:33.843154 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-1fd41435-17ce-4d20-94e6-0eaa59b742b2 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:33.977403 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-1fd41435-17ce-4d20-94e6-0eaa59b742b2 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:33.985229 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-1fd41435-17ce-4d20-94e6-0eaa59b742b2 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712" status: 200 len: 1578 microversion: 2.1 time: 0.156346 Aug 24 03:49:33.985785 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 523/1037] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:33 2022] GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:34.899954 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [req-abeb59c2-444e-45c7-81fc-47e524e6fa25 req-98e0f1e1-877d-4b73-a319-c3877ac9d08d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98a71e9c-31b1-4efe-9580-1aeb161cb712", "name": "network-vif-deleted", "tag": "94e62715-a19a-4e2c-9d13-d5ced48f4941"}]} {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:34.911106 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-abeb59c2-444e-45c7-81fc-47e524e6fa25 req-98e0f1e1-877d-4b73-a319-c3877ac9d08d service nova] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:34.911598 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-abeb59c2-444e-45c7-81fc-47e524e6fa25 req-98e0f1e1-877d-4b73-a319-c3877ac9d08d service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:34.912027 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [req-abeb59c2-444e-45c7-81fc-47e524e6fa25 req-98e0f1e1-877d-4b73-a319-c3877ac9d08d service nova] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:34.924458 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.compute.server_external_events [req-abeb59c2-444e-45c7-81fc-47e524e6fa25 req-98e0f1e1-877d-4b73-a319-c3877ac9d08d service nova] Creating event network-vif-deleted:94e62715-a19a-4e2c-9d13-d5ced48f4941 for instance 98a71e9c-31b1-4efe-9580-1aeb161cb712 on hv-cinder-85426 Aug 24 03:49:34.930244 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [req-abeb59c2-444e-45c7-81fc-47e524e6fa25 req-98e0f1e1-877d-4b73-a319-c3877ac9d08d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034185 Aug 24 03:49:34.930832 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 515/1038] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Aug 24 03:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:49:35.006287 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-c9267701-1612-41c7-8ca0-8b039b4cf86a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:35.006907 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-c9267701-1612-41c7-8ca0-8b039b4cf86a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 98a71e9c-31b1-4efe-9580-1aeb161cb712] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:35.012931 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c9267701-1612-41c7-8ca0-8b039b4cf86a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:35.014750 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c9267701-1612-41c7-8ca0-8b039b4cf86a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:35.015202 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c9267701-1612-41c7-8ca0-8b039b4cf86a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:35.015899 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c9267701-1612-41c7-8ca0-8b039b4cf86a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:35.016356 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c9267701-1612-41c7-8ca0-8b039b4cf86a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:35.016800 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-c9267701-1612-41c7-8ca0-8b039b4cf86a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:35.078065 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.policy [None req-c9267701-1612-41c7-8ca0-8b039b4cf86a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd32bf7e9512f4a51ae52a25bba18b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c742ff2fa942409384b6294cf883ce0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120709) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:35.085727 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-c9267701-1612-41c7-8ca0-8b039b4cf86a tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712" status: 200 len: 1226 microversion: 2.1 time: 0.083369 Aug 24 03:49:35.086279 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 524/1039] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:35 2022] GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:36.108325 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-04ab9f33-fe94-4fc7-a06b-425f1fc32a84 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:36.109047 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-04ab9f33-fe94-4fc7-a06b-425f1fc32a84 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: 98a71e9c-31b1-4efe-9580-1aeb161cb712] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:36.115830 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-04ab9f33-fe94-4fc7-a06b-425f1fc32a84 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:36.116320 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-04ab9f33-fe94-4fc7-a06b-425f1fc32a84 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:36.116778 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-04ab9f33-fe94-4fc7-a06b-425f1fc32a84 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:36.117481 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-04ab9f33-fe94-4fc7-a06b-425f1fc32a84 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:36.117948 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-04ab9f33-fe94-4fc7-a06b-425f1fc32a84 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:36.118378 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-04ab9f33-fe94-4fc7-a06b-425f1fc32a84 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:36.132267 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-04ab9f33-fe94-4fc7-a06b-425f1fc32a84 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] HTTP exception thrown: Instance 98a71e9c-31b1-4efe-9580-1aeb161cb712 could not be found. Aug 24 03:49:36.133905 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-04ab9f33-fe94-4fc7-a06b-425f1fc32a84 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Request method failure captured: Aug 24 03:49:36.133905 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712 HTTP/1.1 Aug 24 03:49:36.133905 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 24 03:49:36.133905 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 24 03:49:36.133905 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Connection: close Aug 24 03:49:36.133905 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 24 03:49:36.133905 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 24 03:49:36.133905 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Host: 10.222.0.81 Aug 24 03:49:36.133905 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 24 03:49:36.133905 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.11 Aug 24 03:49:36.133905 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjBZ5C5Nyg8blEXeQ_OHyi5xfYVpO3ig_gkwsF4RFVgwvEzGzV-XFbKVcFKZeFMHVff9N1OWdpi9vsFospfdzuJ83C1kje2npifOEb7U4FJi_x5Md2OccxsavbDIUuhhH78RjOLkk374i-zeJXK5adKH0abQLWM6i6GnUazmWWqKDZqpY Aug 24 03:49:36.133905 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 24 03:49:36.133905 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 24 03:49:36.133905 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 24 03:49:36.133905 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 24 03:49:36.133905 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 24 03:49:36.133905 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 24 03:49:36.133905 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Id: c742ff2fa942409384b6294cf883ce0a Aug 24 03:49:36.133905 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-TestVolumeBootPattern-212920611 Aug 24 03:49:36.133905 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 24 03:49:36.133905 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 24 03:49:36.135457 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c742ff2fa942409384b6294cf883ce0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_c742ff2fa942409384b6294cf883ce0a", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c742ff2fa942409384b6294cf883ce0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/c742ff2fa942409384b6294cf883ce0a"}]}] Aug 24 03:49:36.135457 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-TestVolumeBootPattern-212920611 Aug 24 03:49:36.135457 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Id: c742ff2fa942409384b6294cf883ce0a Aug 24 03:49:36.135457 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-TestVolumeBootPattern-212920611 Aug 24 03:49:36.135457 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User: tempest-TestVolumeBootPattern-212920611-project Aug 24 03:49:36.135457 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 24 03:49:36.135457 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 24 03:49:36.135457 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Id: d32bf7e9512f4a51ae52a25bba18b891 Aug 24 03:49:36.135457 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-TestVolumeBootPattern-212920611-project Aug 24 03:49:36.135457 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: method: > Aug 24 03:49:36.135457 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: exception: Instance 98a71e9c-31b1-4efe-9580-1aeb161cb712 could not be found. Aug 24 03:49:36.135457 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: action_args: {'id': '98a71e9c-31b1-4efe-9580-1aeb161cb712'} Aug 24 03:49:36.136320 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:49:36.136320 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:36.136320 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:49:36.136320 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:49:36.136320 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:49:36.136320 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:49:36.136320 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:49:36.136320 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:49:36.136320 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:49:36.136320 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:49:36.136320 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98a71e9c-31b1-4efe-9580-1aeb161cb712 could not be found. Aug 24 03:49:36.136320 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:49:36.136320 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:49:36.136320 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:49:36.136320 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:36.136320 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:49:36.136320 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:49:36.136320 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:49:36.136320 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:49:36.136320 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:49:36.137913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:49:36.137913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:49:36.137913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:49:36.137913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:49:36.137913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:49:36.137913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:49:36.137913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:49:36.137913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98a71e9c-31b1-4efe-9580-1aeb161cb712 could not be found. Aug 24 03:49:36.137913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:49:36.137913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:49:36.137913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:49:36.137913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:36.137913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:49:36.137913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:49:36.137913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:49:36.137913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:49:36.137913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98a71e9c-31b1-4efe-9580-1aeb161cb712 could not be found. Aug 24 03:49:36.137913 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:49:36.139879 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-04ab9f33-fe94-4fc7-a06b-425f1fc32a84 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Returning 404 to user: Instance 98a71e9c-31b1-4efe-9580-1aeb161cb712 could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:49:36.139879 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-04ab9f33-fe94-4fc7-a06b-425f1fc32a84 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712" status: 404 len: 111 microversion: 2.1 time: 0.031726 Aug 24 03:49:36.139879 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 516/1040] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:36 2022] GET /compute/v2.1/servers/98a71e9c-31b1-4efe-9580-1aeb161cb712 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:49:36.580547 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-4c290439-b22e-4660-9f3b-646bd3dc5890 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:36.581162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.compute.api [None req-4c290439-b22e-4660-9f3b-646bd3dc5890 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: c490ec9d-3ee8-4751-b1b4-a2a802461fef] Fetching instance by UUID {{(pid=120709) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:36.587841 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4c290439-b22e-4660-9f3b-646bd3dc5890 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:36.588322 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4c290439-b22e-4660-9f3b-646bd3dc5890 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:36.588756 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4c290439-b22e-4660-9f3b-646bd3dc5890 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:36.589466 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4c290439-b22e-4660-9f3b-646bd3dc5890 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:36.589917 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4c290439-b22e-4660-9f3b-646bd3dc5890 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:36.590340 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG oslo_concurrency.lockutils [None req-4c290439-b22e-4660-9f3b-646bd3dc5890 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:36.606337 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.wsgi [None req-4c290439-b22e-4660-9f3b-646bd3dc5890 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] HTTP exception thrown: Instance c490ec9d-3ee8-4751-b1b4-a2a802461fef could not be found. Aug 24 03:49:36.608844 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-4c290439-b22e-4660-9f3b-646bd3dc5890 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Request method failure captured: Aug 24 03:49:36.608844 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: request: DELETE /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef HTTP/1.1 Aug 24 03:49:36.608844 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept: application/json Aug 24 03:49:36.608844 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Accept-Encoding: identity Aug 24 03:49:36.608844 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Connection: close Aug 24 03:49:36.608844 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Length: 0 Aug 24 03:49:36.608844 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Content-Type: application/json Aug 24 03:49:36.608844 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Host: 10.222.0.81 Aug 24 03:49:36.608844 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Openstack-System-Scope: None Aug 24 03:49:36.608844 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: User-Agent: python-urllib3/1.26.11 Aug 24 03:49:36.608844 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Auth-Token: gAAAAABjBZ5C5Nyg8blEXeQ_OHyi5xfYVpO3ig_gkwsF4RFVgwvEzGzV-XFbKVcFKZeFMHVff9N1OWdpi9vsFospfdzuJ83C1kje2npifOEb7U4FJi_x5Md2OccxsavbDIUuhhH78RjOLkk374i-zeJXK5adKH0abQLWM6i6GnUazmWWqKDZqpY Aug 24 03:49:36.608844 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Id: None Aug 24 03:49:36.608844 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Domain-Name: None Aug 24 03:49:36.608844 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Identity-Status: Confirmed Aug 24 03:49:36.608844 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Is-Admin-Project: True Aug 24 03:49:36.608844 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Id: default Aug 24 03:49:36.608844 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Domain-Name: Default Aug 24 03:49:36.608844 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Id: c742ff2fa942409384b6294cf883ce0a Aug 24 03:49:36.608844 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Project-Name: tempest-TestVolumeBootPattern-212920611 Aug 24 03:49:36.608844 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Role: reader,member Aug 24 03:49:36.608844 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Roles: reader,member Aug 24 03:49:36.610594 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c742ff2fa942409384b6294cf883ce0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_c742ff2fa942409384b6294cf883ce0a", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c742ff2fa942409384b6294cf883ce0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/c742ff2fa942409384b6294cf883ce0a"}]}] Aug 24 03:49:36.610594 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant: tempest-TestVolumeBootPattern-212920611 Aug 24 03:49:36.610594 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Id: c742ff2fa942409384b6294cf883ce0a Aug 24 03:49:36.610594 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-Tenant-Name: tempest-TestVolumeBootPattern-212920611 Aug 24 03:49:36.610594 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User: tempest-TestVolumeBootPattern-212920611-project Aug 24 03:49:36.610594 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Id: default Aug 24 03:49:36.610594 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Domain-Name: Default Aug 24 03:49:36.610594 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Id: d32bf7e9512f4a51ae52a25bba18b891 Aug 24 03:49:36.610594 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: X-User-Name: tempest-TestVolumeBootPattern-212920611-project Aug 24 03:49:36.610594 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: method: > Aug 24 03:49:36.610594 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: exception: Instance c490ec9d-3ee8-4751-b1b4-a2a802461fef could not be found. Aug 24 03:49:36.610594 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: action_args: {'id': 'c490ec9d-3ee8-4751-b1b4-a2a802461fef'} Aug 24 03:49:36.611569 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:49:36.611569 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:36.611569 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:49:36.611569 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:49:36.611569 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:49:36.611569 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:49:36.611569 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:49:36.611569 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:49:36.611569 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:49:36.611569 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:49:36.611569 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c490ec9d-3ee8-4751-b1b4-a2a802461fef could not be found. Aug 24 03:49:36.611569 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:49:36.611569 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:49:36.611569 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:49:36.611569 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:36.611569 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:49:36.611569 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:49:36.611569 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:49:36.611569 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:49:36.611569 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:49:36.613162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:49:36.613162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:49:36.613162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:49:36.613162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:49:36.613162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:49:36.613162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:49:36.613162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:49:36.613162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:49:36.613162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:49:36.613162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c490ec9d-3ee8-4751-b1b4-a2a802461fef could not be found. Aug 24 03:49:36.613162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:49:36.613162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:49:36.613162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:49:36.613162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:36.613162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:49:36.613162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:49:36.613162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:49:36.613162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:49:36.613162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c490ec9d-3ee8-4751-b1b4-a2a802461fef could not be found. Aug 24 03:49:36.613162 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: ERROR nova.api.openstack.wsgi Aug 24 03:49:36.614695 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-4c290439-b22e-4660-9f3b-646bd3dc5890 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Returning 404 to user: Instance c490ec9d-3ee8-4751-b1b4-a2a802461fef could not be found. {{(pid=120709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:49:36.614695 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-4c290439-b22e-4660-9f3b-646bd3dc5890 tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "DELETE /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef" status: 404 len: 111 microversion: 2.1 time: 0.033702 Aug 24 03:49:36.614695 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 525/1041] 10.222.0.81 () {58 vars in 1239 bytes} [Wed Aug 24 03:49:36 2022] DELETE /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:49:36.619956 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-786ba2cc-283d-4250-9892-9690ab10cb4d tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '>' {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:36.620571 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.compute.api [None req-786ba2cc-283d-4250-9892-9690ab10cb4d tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] [instance: c490ec9d-3ee8-4751-b1b4-a2a802461fef] Fetching instance by UUID {{(pid=120708) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:36.626933 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-786ba2cc-283d-4250-9892-9690ab10cb4d tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:36.627416 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-786ba2cc-283d-4250-9892-9690ab10cb4d tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:36.627852 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-786ba2cc-283d-4250-9892-9690ab10cb4d tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:36.628574 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-786ba2cc-283d-4250-9892-9690ab10cb4d tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Acquiring lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:36.629053 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-786ba2cc-283d-4250-9892-9690ab10cb4d tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:36.629483 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG oslo_concurrency.lockutils [None req-786ba2cc-283d-4250-9892-9690ab10cb4d tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Lock "ed5b7d00-8e19-4d94-83cc-5821156784d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:36.643121 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.wsgi [None req-786ba2cc-283d-4250-9892-9690ab10cb4d tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] HTTP exception thrown: Instance c490ec9d-3ee8-4751-b1b4-a2a802461fef could not be found. Aug 24 03:49:36.644630 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-786ba2cc-283d-4250-9892-9690ab10cb4d tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Request method failure captured: Aug 24 03:49:36.644630 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: request: GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef HTTP/1.1 Aug 24 03:49:36.644630 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept: application/json Aug 24 03:49:36.644630 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Accept-Encoding: identity Aug 24 03:49:36.644630 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Connection: close Aug 24 03:49:36.644630 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Length: 0 Aug 24 03:49:36.644630 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Content-Type: application/json Aug 24 03:49:36.644630 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Host: 10.222.0.81 Aug 24 03:49:36.644630 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Openstack-System-Scope: None Aug 24 03:49:36.644630 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: User-Agent: python-urllib3/1.26.11 Aug 24 03:49:36.644630 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Auth-Token: gAAAAABjBZ5C5Nyg8blEXeQ_OHyi5xfYVpO3ig_gkwsF4RFVgwvEzGzV-XFbKVcFKZeFMHVff9N1OWdpi9vsFospfdzuJ83C1kje2npifOEb7U4FJi_x5Md2OccxsavbDIUuhhH78RjOLkk374i-zeJXK5adKH0abQLWM6i6GnUazmWWqKDZqpY Aug 24 03:49:36.644630 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Id: None Aug 24 03:49:36.644630 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Domain-Name: None Aug 24 03:49:36.644630 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Identity-Status: Confirmed Aug 24 03:49:36.644630 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Is-Admin-Project: True Aug 24 03:49:36.644630 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Id: default Aug 24 03:49:36.644630 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Domain-Name: Default Aug 24 03:49:36.644630 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Id: c742ff2fa942409384b6294cf883ce0a Aug 24 03:49:36.644630 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Project-Name: tempest-TestVolumeBootPattern-212920611 Aug 24 03:49:36.644630 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Role: reader,member Aug 24 03:49:36.644630 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Roles: reader,member Aug 24 03:49:36.646457 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c742ff2fa942409384b6294cf883ce0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_c742ff2fa942409384b6294cf883ce0a", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c742ff2fa942409384b6294cf883ce0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/c742ff2fa942409384b6294cf883ce0a"}]}] Aug 24 03:49:36.646457 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant: tempest-TestVolumeBootPattern-212920611 Aug 24 03:49:36.646457 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Id: c742ff2fa942409384b6294cf883ce0a Aug 24 03:49:36.646457 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-Tenant-Name: tempest-TestVolumeBootPattern-212920611 Aug 24 03:49:36.646457 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User: tempest-TestVolumeBootPattern-212920611-project Aug 24 03:49:36.646457 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Id: default Aug 24 03:49:36.646457 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Domain-Name: Default Aug 24 03:49:36.646457 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Id: d32bf7e9512f4a51ae52a25bba18b891 Aug 24 03:49:36.646457 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: X-User-Name: tempest-TestVolumeBootPattern-212920611-project Aug 24 03:49:36.646457 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: method: > Aug 24 03:49:36.646457 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: exception: Instance c490ec9d-3ee8-4751-b1b4-a2a802461fef could not be found. Aug 24 03:49:36.646457 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: action_args: {'id': 'c490ec9d-3ee8-4751-b1b4-a2a802461fef'} Aug 24 03:49:36.647279 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: {{(pid=120708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:49:36.647279 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:36.647279 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:49:36.647279 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:49:36.647279 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:49:36.647279 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:49:36.647279 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:49:36.647279 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:49:36.647279 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:49:36.647279 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:49:36.647279 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c490ec9d-3ee8-4751-b1b4-a2a802461fef could not be found. Aug 24 03:49:36.647279 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:49:36.647279 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:49:36.647279 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:49:36.647279 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:36.647279 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:49:36.647279 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:49:36.647279 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:49:36.647279 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:49:36.647279 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:49:36.648623 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:49:36.648623 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:49:36.648623 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:49:36.648623 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:49:36.648623 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:49:36.648623 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:49:36.648623 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:49:36.648623 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c490ec9d-3ee8-4751-b1b4-a2a802461fef could not be found. Aug 24 03:49:36.648623 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:49:36.648623 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:49:36.648623 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:49:36.648623 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:49:36.648623 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:49:36.648623 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:49:36.648623 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:49:36.648623 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:49:36.648623 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c490ec9d-3ee8-4751-b1b4-a2a802461fef could not be found. Aug 24 03:49:36.648623 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: ERROR nova.api.openstack.wsgi Aug 24 03:49:36.649990 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: DEBUG nova.api.openstack.wsgi [None req-786ba2cc-283d-4250-9892-9690ab10cb4d tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Returning 404 to user: Instance c490ec9d-3ee8-4751-b1b4-a2a802461fef could not be found. {{(pid=120708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:49:36.649990 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO nova.api.openstack.requestlog [None req-786ba2cc-283d-4250-9892-9690ab10cb4d tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef" status: 404 len: 111 microversion: 2.1 time: 0.029998 Aug 24 03:49:36.649990 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: [pid: 120708|app: 0|req: 517/1042] 10.222.0.81 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:36 2022] GET /compute/v2.1/servers/c490ec9d-3ee8-4751-b1b4-a2a802461fef => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:49:37.953953 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: DEBUG nova.api.openstack.wsgi [None req-01f7045b-e9c9-4f09-ad30-11837a0c56ef tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] Calling method '.version_select at 0x7f942f2f8940>' {{(pid=120709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:37.978799 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO nova.api.openstack.requestlog [None req-01f7045b-e9c9-4f09-ad30-11837a0c56ef tempest-TestVolumeBootPattern-212920611 tempest-TestVolumeBootPattern-212920611-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1735211970" status: 202 len: 0 microversion: 2.1 time: 0.029572 Aug 24 03:49:37.979640 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: [pid: 120709|app: 0|req: 526/1043] 10.222.0.81 () {58 vars in 1263 bytes} [Wed Aug 24 03:49:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1735211970 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:50:19.941447 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:50:19.941964 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Wed Aug 24 03:50:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:50:24.600607 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:50:24.601354 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Wed Aug 24 03:50:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:51:56.374463 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:51:56.375123 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Wed Aug 24 03:51:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:52:18.515385 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:52:18.515981 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Wed Aug 24 03:52:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:52:18.849962 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:52:18.850549 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Wed Aug 24 03:52:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:53:39.949554 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:53:39.950482 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Wed Aug 24 03:53:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:53:44.609356 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:53:44.610126 dv-cinder-854261-1-iscsi devstack@n-api.service[120708]: Wed Aug 24 03:53:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:54:53.063970 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:54:53.064616 dv-cinder-854261-1-iscsi devstack@n-api.service[120709]: Wed Aug 24 03:54:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!